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ABSTRACT 

This book argues that schools are doing a better job 
than is commonly portrayed by the media and various commission 
reports. However, it cautions that schools must move beyond 
incremental improvements. One need not assume school failure to 
propose school reform. Chapter 1 examines limitations of the research 
that has portrayed a national educational crisis, especially the 
report, **A Nation at Risk" (1983). The perceptions of a troubled 
educational system are fueled by the latest focus on economic 
threats, the media, and educators. Chapter 2 shows that previous 
examinations of schools have failed to take into account many of the 
subtleties in the data. It also argues that the social context in 
which schools function is declining, which is overlooked by many 
reports. Therefore, an objective systemic approach is needed to 
understand schools and the environment in which they operate. Chapter 
3 gives further reasons for using a systems approach. The remaining 
eight chapters are devoted to: the changing concepts of learning 
theory; applying a consumer approach to setting standards; adopting 
authentic assessment; examining the problems with school choice; 
providing equitable funding; defining the system and its goals; 
providing comprehensive programs to ensure student readiness; and 
preparing for the impact of technology on education. Thirteen figures 
are included. Each chapter contains references. (LMl) 



\\ Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc i< Vc i< i< i< i< Vc Vc Vc Vc Vc i< i< it Vc Vc Vc ik Vc Vc Vc :>*c it Vc Vc 

Reproductions supplied by EDRS are the best that can be made ''^ 

from the original document. 

* Vc * * * * * * Vc Vc * ?V * ?V iSf * 1^ Vc Vc 1^ Vc Vc Vc Vc Vf Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc Vt Vc Vc Vc Vc Vc Vc Vc Vc Vc Vc 




By Gerald WBiacey 



U.S. OCMKTMCNT Of tOUCATION 
Oflict ot EducatioAAl RM««tch •r>d lm(yov»fn«nt 

EDUCATIONAL RESOURCES rNFORMATlON 
CENTER (ERICI 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



'•C«iv»<3 Worn th« O«rton or org«niX«tion i 
ongintting it 

□ Minor ch«ng*« h«v« b««n m«d« to improv* i 
'•production Qu«tity , 

• Poinift or view or optnioni ftt«t«d m (hit docu- 
m«nt do not n«c*tMrily reprtMnt oHici«l i 
OERl potition or po<iCv ' > 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



o 

WU 
CO 



Copyright '& 1994, American Association of School Administratoi-s 

LibraiA' ot Congress C>atalog Card Number: 94-078508 
ISBN: 0-87652-211-8 
AASA Stock Number: 21-00470 

This report was reviewed by AASA and appnned for publication. 
Approval does not signifv' that the contents reflect the views or policies of .\.\SA. 



ERIC 



BEST COPY AVAILABLE 



TABLE OF CONTENTS 



PREFACE / 

INTRODUCTION 

CHAPTER 1 

"A NATION AT RISK" 

AND OTHER QUESTIONABLE LOOKS AT EDUCATION 
Shedding New Light on "Risk" 
The Essence of Criticisms Past 
Erroneous Assumptions, Beliefs Persist 

CHAPTER 2 

THE REAL STATE OF THE SYSTEM 

Achievement Up Despite Social Decline 
Objective, Systemic Approach Needed 

CHAPTER 3 

THE NEED FOR A SYSTEMS APPROACH 

Systems Thinking Not the Norm 
Why a Systems Approach Is Needed 

CHAPTER 4 

HOW PEOPLE LEARN AND WHY IT^S 

IMPORTANT TO KNOW 

History of Thought Clouds Learning Theory Today 

Researchers Adopt Psychology Model 

Education Strategies Should Reflect Learning Research 

Change of Pace Needed 

CHAPTER 5 

THE QUESTION OF STANDARDS FOR LEARNERS .... 
Why People Want Standards 
Reasons for Not Having Standards 
Process for Setting Standards Unclear 

CHAPTER 6 

SYSTEMS AND THE ASSESSMENT OF LEARNERS 

Current Approaches Obscure Quality 
Tests Rarely Measure What's Important 
Student Motivation Affects Comparisons, Validity 
A New, Authentic Approach Is Needed 



CHAPTER 7 



CHOICE AND STANDARDS ^ 77 

Choice's Main Pretext and Its Inherent Problems 
The Possible Future of Choice 

CHAPTER 8 

FUNDING THE SYSTEM 85 

Equity: A (x)mplex Issue 



Needed First: A Better Understanding of Funding 
Intensive Care Needed for the Most Disadvantaged 

CHAPTER 9 

THE PURPOSE OF THE SYSTEM AND ITS GOALS 93 

Philosophical Barriers To Defining Education's Purpose 



Definitions of Years Past 
The Need To Go Beyond Knowledge 

CHAPTER 10 

CHANGES IN LEARNERS: IMPAC T ON THE SYSTEM 101 

We Are Less of a Melting Pot Than Ever 
Children Are Less Ready 

CHAPTER 11 

WIRING THE SYSTEM 109 

The Myth of the Technological Revolution 
Barriers to the Use of Computers in Schools 
Benefits of Use Beginning To Be Realized 
Impact on Teaching 
Impact on Achievement, Students 
Impact on Thinking, vSchools 

EPILOGUE 123 

ABOUT THE AUTHOR : 125 

ACKNOWLEDGMENTS 127 



PREFACE 



Just what is the condition of American education today? Like the old adage, 
there's good news and bad news. The good news is our schools are doing 
a good job. The bad news is they may need to be doing a different job. 
On the other hand, our public schools are poised to make changes in the 
system that will lead to students who are even better prepared for life in 
the 21st Century. 

Transforming America s Schools, prepared by noted research psychologist and 
education writer Gerald W. Bracey, goes beyond previous "Bracey Reports 
on the Condition of Education ' to pose a strong case that schools are making 
great strides with children. Then, it points school leaders in the direction 
of systemic changes that must be made to transform, not just reform, our 
nation s schools. We urge educators and others who care deeply about public 
education to draw from what this inspired publication has to say. 

Bracey has plowed through a virtual mountain of data on the status of 
learning and achievement in the public schools. What he has foimd, in case 
after case, is that the gloomy pictures painted by \arious commissions and 
news media reports often have been grossly exaggerated. 

In fact, the reports have been countered by recent sur\'eys, such as the 
Gallup Poll on public attitudes toward public education and a 1994 American 
Association of School Administrators public opinion study. Both have shown 
that most citizens, while always wanting their schools to do better, feel they 
are doing a ver)' good job. 

What does Transforming Americas Schools have to say to school leaders? 
First, it tells us that educators need a pat on the back for leadership that 
has led to success for so many of our citizens up to this point. Second, in 
my opinion, it makes clear that we need to move beyond incremental, step-by- 
step improvements, because we are living in a fast-changing environment. 

To make these changes, educators, parents, nonparent taxpayers, leaders 
in business and government, in fact ex'eiyone, needs to lend support as our 
nation transforms its school systems. Our children deser\'e no less. They, after 
all, will be our leaders in the 21st Century. 

This publication is another reflection of the new AASA, an organization 
with a proud history dating back to 1865, but moving today on the cutting 
edge of positive change. 

Paul I). Houston 
i?'.xecutivc Director 

\inencan Association of School Administrators 

I Rx pi 
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AS a prisoner of the Germans in World War II, novelist Rurt Vonnegut 
spent part of his life in a Dresden meat packing plant. While he was 
there, the Allies firebombed this supposedly "safe'' city— killing 135,000 people. 
Vonnegut survived, protected by the cold and damp of the underground 
slaughterhouse. But he was forever haunted by his memory of the city's 
destruction. 

In an opening chapter of Slaughterhouse Five, his novel about the experience 
(Slaughterhouse Five was the address), Vonnegut tells a friend of his Dresden- 
inspired intent to write an anti-war book. The friend's wife became furious. 
"Why don't you write an anti-glacier book!," she says. She meant that anti-war 
books no more stop wars than an anti-glacier book would stop a glacier. 

A reader could look at the title of this publication and wonder why I 
didn't write an anti-glacier book. Do we need yet another examination of 
the nation's educational system? 

Obviously I and AASA think so, and that's partly because of what I bring 
to such an enterprise: formal training in developmental and cognitive psychology; 
a decade of writing monthly research columns on educational and psychological 
research; and research on computers; work in developing innovative assess- 
ment techniques over the last 15 years; and experiences in state, local, universi- 
ty, and private educational institutions. I believe this background permits 
some singular perspectives on what is— or is not— happening in schools. 

In fact, it was my previously published perspectives that led to the docu- 
ment in your hands. I'm speaking particularly of three earlier essays known 
as the First, Second, and Third "Braccy Report on the Condition of Public 
Education," published in Phi Delta Kappan}-^-^ 

The First Bracey Report developed over a period of about two months 
in late 1990. 1 had found myself, almost by accident, in possession of a moun- 
tain of data on achievement tests, SAT's (Scholastic Aptitude Tests), dropout 
rates, international comparisons, and other indicators that compelled me 
to conclude the conventional wisdom that American education had failed 
was wrong. 

Earlier that fall, I had been like most American parents. I thought the 
local public schools my children had attended were "okay," but elsewhere 
there was a crisis in education. In fact, I thought the education my chil- 
dren had received in Virginia and Colorado was superior to mine. For ex- 
ample, their biology coui*ses dealt with enzymes, complex biochemical reac- 
tions, genetics and evolution, and ecology. I had memorized phyla. Yet report 
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after report from various commissions and in the news media depicted a 
school system in crisis. 

A change of heart* Then I came across an essay by syndicated Washhigtori 
Post columnist Richard Cohen, entitled "Johnny's Miserable SATs^^ I knew 
the situation was not as deplorable as Cohen felt, but I also knew that almost 
15 years had passed since a College Board-appointed commission had taken 
a close look at the trends. In addition, I had always felt that the commission 
headed by former US. Secretary of Libor Willard Wirtz had made a fim- 
damental error in its 1977 inquir)*. Because of Cohen's piece and my feelings 
about the Wirtz Report. I undertook an analysis of SAT score trends. Using 
the methods friends at the Educational Testing Sen'ice called "reasonable," 
I found only a 22-p()int decline in the verbal score and a 5-point rise in 
the mathematics average since 1951. Cilearly the situation was much healthier 
than Cohen thought or than was commonly reported and widelv believed. 
I published that conclusion in FAxicatim Week as "SAT's: Miserable or 
Miraculous?"*'^ 

That article prompted a number of colleagues around the country to 
send me or direct me to various other studies that also indicated that our 
nations educational system was in better shape than commonly belie\'ed. 
A 1990 essay by Iris Rotberg of the National Science Foundation concluded 
that the international comparisons often used to flagellate schools were fun- 
damentally flawed.® About this same time, I was asked to do a report on 
local, state, and national dropout rates and found them much lower than 
often reported in the print media. 

Next, I received a phone call from a group of engineers at Sandia National 
Uiboratories in Albuquerque, New Mexico. It seemed that then-US. Secretar)' 
of Knerg)' James Watkins had delivered a speech at Sandia in which he said 
education was to be a Sandia priority. Being systems engineers, the Sandia 
group decided they had best study the system Watkins had directed them 
to pay attention to. In the process, they had collected many data that cor- 
roborated mine, they said, and wanted to share them with me. 

After they presented their findings, I suggested we put all the results to- 
gt ther and publish them somewhere. 1 hey demurred, saying they were "buried 
in internal politics." But they also said they had no proprielaiy interest in 
the data, most of which they had taken from public documents published 
by the US. Census Biucau, the US. Bureau of Ixibor Statistics and, especially, 
the US. Department of Kducation. They encouraged me to go it alone and I did. 
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Taking all of this information and much more that soon came along 
in documents such as Accelerating Academic Achievement^ a summary of NAEP 
trends; and Performance at the Topf a report on high scoring students and 
tough tests; I wrote an article called, "Why Can't They Be Like We Were?" 
The title, a piece of a lyric from the 1960 musical, "Bye Bye Birdie," reflected 
the impression I had gotten from many people who criticized today's schools. 
They often waxed nostalgic about some "Golden Age" of American education 
from which we had declined and to which we should return. (The timing 
of this Golden Age varies; it usually turns out to be when the rememberer 
w^s in school.) (As for the Sandia analyses, after two years of alleged suppres- 
sion by the Bush administration, the report, "Perspectives on Education in 
America," was published as the entirety of the May/June 1993 issue of the 
Journal of Educational Research?) 

After "Why Cant They Be. . ." appeared in the October 1991 issue of 
Phi Delta Kappan, even more peers called my attention to additional informa- 
tion. In a few months, I had sufficient new material to propose a follow-up 
article to the Kappan editors. It ended up being the "Second Bracey Report 
on the Condition of Public Education," "Why Can t . . ." now being considered 
the first. 

Shortly after ' The Second Bracey Report" appeared, I was approached by 
AASA leaders who found the arguments of the two reports compelling— but 
were wondering what came next. They asked, "Wliere do we go from here to 
improve education?" It is hoped that this document will provide some answers. 

At the time this book went to press, we were approaching publication 
of the "Fourth Bracey Report." Kappan editors believe, and I conair, that 
the Bracey Report and others like it should appear annually as long as there 
is sufficient new data to merit their publication. 

Conclusion 

At the risk of being redundant, let me be clear about my position: One 
need not assume school failure to propose school reform. In one article about 
the current fad of "reengineering" in business and industry', I recall one CEO 
of an already profitable company saying something like "Wc just decided 
to sit down and ask "*if we were designing our company today, what would 
it look like?"' That sounds like a healthy approach to change. The American 
educational system was not "designed," really, so it may pay big dividends 
to ask how it might better accomplish its goals. 
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CHAPTER ONE I 

Beginning more than a century ago, at least as early 
as 1883, many individuals, committees, and com- I 
missions have examined the US. educational system 
and found it wanting. Indeed, criticism waned only 
during the Great Depression and World Wars I and 
II, when people presumably had other things to think 
about. Otherwise, the negative tone and content of 
the century's studies of education have been remark- 
ably constant. 



Shedding New Light on 'Risk' 

This publicatio /s present examination of education's critics begins with "A 
Nation at Risk,''^ which put education in the public eye as never seen before. 
**Risk" stimulated reform efforts great and small that have been sustained 
for a decade and show no sign of diminishing. Given its significance, it's 
important to put this seminal document in perspective. 

Based on wrong conclusions 

In examining the educational system, we must distinguish clearly between 
where we are and what it means to be there, and where we want to be and 
what it will take to get there. These are independent issues, but often not 
treated as such. As with a number of earlier reform documents, **Risk" con- 
fused the two and linked them unnecessarily. Much of the attempted educa- 
tional reform that followed this "paper Sputnik" also mistakenly coupled an 
appropriate desire to improve education with an inappropriate assumption 
that the system had failed. The authors of "A Nation at Risk" observed that 
educational systems in other countries were catching up to us. They argued 
that this would have been "unimaginable" a decade earlier. The authors of 
"Risk" might have seen the gains of other nations as natural phenomena- 
events to be expected as these other countries thrived. Germany and Japan 
certainly had no place to go but up after the second World War. Beyond 
that, it would have been ag-ainst the character of nations to sit around con- 
tentedly, allowing the United Stales to dominate education and world affairs 
other than military. 

"Risk's" drafters, however, did not reach this conclusion. Instead, they 
auributed the narrowing difTereiues among nations to a dangerous decay 
in the U.S. education system. Although they wrote in the introduction that, 



"The Commission was impressed during the course of its activities by the 
diversity of opinion it received regarding the condition of American educa- 
tionr no such diversity characterized the final report. "Our nation is at risk^ 
declared the opening sentence. "Our once unchallenged preeminence in com- 
merce, industry, science, and technological innovation is being overtaken by 
competitors throughout the world." 

One could wonder, as educational historian Lawrence Cremin later did, 
how large a rolt schools really played in these changes. The authors, however, 
left no doubt wit^. their cold warrior rhetoric: 

If an unfriendly foreign power had attempted to impose on America 
the mediocre educational performance that exists today, we might 
well have \'iewed it as an act of war. As it stands, we have allowed 
this to happen to ourselves. We have even squandered the gains in 
student achievement made in the wake of the Sputnik challenge. 
Moreover, we have dismantled essential support systems which helped 
make those gains possible. We have, in effect, been committing an 
act of unthinking, unilateral educational disarmament. 



An inappropriate use of the SAT 

To be sure, some indicators had declined. At the time "Risk" appeared, 
the national average score on the SAT (Scholastic Aptitude lest) had an un- 
broken fall of 20 consecutive years. But that was then. The national SAT 
scores and trends have subsequently been revealed as much more complex 
than previously thought and highly misleading. Their complexity and illusory 
nature are discussed later. For now we note only that since the Wirtz Committee 
made its report in 197 each minute change in the SAT has been front page 
news—making the SAT the leading indicator of educational health,^ Although 
the Educational Testing Service and the College Board repeatedly have denied 
that the SAT reflects anything about school quality and even changed the 
name in 1994 to Scholastic Assessment Test, it is still vie\\ed that way by 
many, including those who composed "A Nation At Risk." 

Moreover, "Risk" authors accepted the decreased standardized achieve- 
ment test scores of high school students in the '60s and 70s as valid indicators 
of decline. They failed to notice, however, that the drop had hailed and that 
scores had been rising for eight years prior to the publication of their docu- 
ment. Nor did they mention that this was not the case for elemental^ scores. 
They commented only that the scores were lower than when sputnik was 
launched. 
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Selective use of other data 

In their desire to impress the nation with the severity of the problem, 
**Risk" ATiters were often highly selective in the data they chose and how 
they chose to interpret Ix. For example, they pointed to declines on the National 
Assessment of Educational progress (NAEP) science assessment for 17-year- 
olds. They omitted scores from 9- and 13-year-olds— which had only a slight 
decline, later recouped. They also ignored trends in read'.ng and mathematics. 
These showed no sign of decline during the same pe lod. It would be mind 
reading to guess why they did this, but the record shouIJ show that these 
other scores and trends do not support the crisis rhetoric Nation At Risk!' 

The record should also show that the report's writers even cited some 
indicators of risk for which no data existed. They declared, for example, 
that the average achievement of students graduating from college had de- 
clined, and that 50 percent of gifted and talented students never achieved 
commensurate with their potential. Nowhere are there data that begin to 
adtlress these two assertions. In fact, only now are some reformers calling 
for a national test for college graduates— a summons that would be humorous 
if it were not so serious. (The proposals are for a test that does not identify 
individuals or colleges. Eighth- and twelfth-graders do nc/t take the existing 
NAEP veiT seriously. One can only imagine how college seniors would "blow 
o\T an examination that has no personal impact.) 

The Essence of Criticisms Past 

As nof^d earlier, sounding an alarm for a failing U.S. educational system is 
hardly new. hi 1883, (me J.M. Rice looked at the public schools and found 
them lacking in supenision, awash with untrained teachers, and controlled by 
politically coniipt boards:^ In the 192()s, ihe Amniran Educational Digest carried 
regular feature called, 'tlriticism ol' Education," which summarized and re- 
printed critiques found in the press around the countiy It v.':is riddled with 
comments about schools stifling thought, not teaching creativity, and failing 
to teach the "Three Rs" At the same time, they were accused of adding frivolous 
dcctives, costing too much, tiying to deal with "overloaded ciuTicula," short- 
changing the gifted and talented, and lacking purpose. One article accused 
teachers of neglecting arithmetic because of the advent of *V;omptometers 
and calculatin.g machines^'* 

The Arkamas Demon at did state that 'Vfiiciency experts" were tiying to 
take the joy out of lite when they called for the aboliticm of vacati(ms; and 



admitted to having "more than a slight suspicion that the experts aren t nearly 
so efficient themselves as they are trying to look as they hand out theories 
about how the world should be mnl'^ 

One New York City writer observed that when a city school burned, 500 
pupils gathered nearby and danced with glee. His solution is quite contem- 
porary: Make the schools more like businesses. 'A manufacturer turning out 
poor material would lose his market, but the school goes on regardless of 
its output, without much attention from those who pay the bills:*^ 

And while critics most often attacked elementary and secondar)' schools, 
higher education did not escape unscathed. College students were excoriated 
periodically for both their radicalism and their godlessness. 

The last centur)' has seen such constant carping about schools that in 
his book, Public Education and Its Discontents, educational historian Lawrence 
Cremin commented wi7ly, "Just about the time Adam first whispered to Eve 
that the)' were living in an age of transition, the Serpent doubtless issued 
the first complaint that academic standards were beginning to decline:"' So 
frequent were the complaints and so common were their contents that one 
would have to conclude that educators are an unusually stupid, recalcitrant 
bunch— or, if you prefer, that the critics are off target. 

Focus on national threat 

The critics have waxed loudest when they liave perceived some national 
threat that could possibly be averted by increases in education or in education's 
effectiveness, or both. The outcomes of World Wars I and II were determined 
by sheer force, of course, and the Great Depression refiected a worldwide 
economic collapse. Beating back the Red Menace, on the other hand, de- 
pended at least in part on education— or so many people thought. 

After the Russians launched Sputnik, the first manmade satellite, in 1957, 
magazines fired ofi many articles critical of American schools. In March 1958, 
Life magazine featured an essay by Sloan Wilson, author of The Man in tfw 
Gray Flannel Suit, declaring schools operated a '^carnival."' Wilson produced 
a litany of laments: the diploma had declined to meaninglessness; the rise 
of electives had swept out rigor; students no longer learned basic skills; text- 
books had been watered down; intellectually gifted students were shunned 
by their peers. Except for a tew giveaway names and terms that date the 
piece, Wilsons essay could be taken as a thoroughly modern critique. 

Wilsons dirge was tiie opening of a strident foiu-part Ltfe series compar- 



ing US. schools with those in the Soviet Union. The series left no doubt: 
Without massive education reform in America, the Russians would, as Khruschev 
would soon say, buiy us. 

But Life magazine was hardly alone or extreme in its views. Reader's Digest 
declared, "We are offering them a slingshot education in a hydrogen bomb 
age:'^ Echoing Rudolph Flesch's popular 1957 tome. Why Johnny Cant Read!"^ 
Arthur Chase weighed in with a 1961 book: What Ivan Knows That Johnny 
DoesnV.^ It was the first of many post-Flesch lumps that "Johnny'' would take. 

The educational reforms following Sputnik were not cast in terms of 
using the liberal arts to increase the quality of daily life, to improve the quality 
of society, or to increase our economic competitiveness with other nations— 
but rather to preserve the nation. The lai^gest of the federal efforts v/as called 
simply, "The National Defeme Education Act" (emphasis added). 

Economic threat, the latest twist 

Today, the perceived threats are not primarily ideological, political, or 
even militaiy. They arc economic and, again in the eyes of many, it is the 
schools that must rescue and preserve the union. The schools, of course, 
must themselves first be rescued. 

During the last year of the Bush administration, both Bush and then-US. 
Secretary of Education l^mar Alexander said repeatedly, "For the nation 
to change, the schools must change." It began to sound like a mantra. Fortu- 
nately, the C^linton administration reversed the order of causality. In 1993, 
US. Secretary of Education Richard Riley said, "We can t get our education 
house in order until we get our economic house in order." 

Indeed, we can, and should, ask why a system in which children spend 
only 9 percent of their lives between birth and age 18 must bear the burden 
of leading the nation forward. We can also ask how much the schools alone 
can accomplish without the assistance or support of the family and other 
social institutions. 

Erroneous Assumptions^ Beliefs Persist 

As mentioned earlier, along with their desire to improve schools, many people 
hold a notion of a (iolden Age of American schooling ag-ainsl which the 
cun ent system compares badly. Such comparisons are wrong and e^'en diuigerous. 
As Lawrence Stedman of the State University of New York has written, "We 




should all have serious doubts about a so-called Golden Age of education 
and be leeiy of looking back wistfully for solutions."''^ Nevertheless, many 
reform efforts ha\'e been predicated on the assumption that the typical school 
has tailed, comparatively, and that the t\'pical student knows less each year. 

Syndicated Wasfwigkm Post columnist Richard Cohen captured the sen- 
timents of many when he wrote in August 1992 that, ^^Duringthie Reagan-Bush 
years, . .the countiT got dumber on just about eveiy achievement test the 
kids could take,"'' While it's tine that scores on commercial, standardized 
achievement tests declined in the late 6()s to the mid-7()s, they later reversed 
direction and headed up again. By 1986, RAKD researcher Daniel Koretz, 
then with the Congressional Budget Office, reported what the Bell (^onnnis- 
sion had overlooked:'" '' Some scores were at ;U)-year highs. He also ob- 
sened that it was hard to attribute either the decline or the later rise to 
what was happening in the schools. By the time (>)hen penned iiis lines, 
some scores had risen to all-time highs. 

A fair assessment? 

Of course many hold, quite properly, that connnercial achievement tests 
are not adequate tools for evaluating the quality of the system. A recent study 
conunissioned by the National Science Foundation'*'^ analyzed such tests in 
mathematics and science and concluded that these tests are veiv well designed 
instnmients that do not measure anything particularly important. Only a 
tiny fraction of the items cover high (juality content or require higher order 
thinking, even at the high school levels. Nor do they adequately match the 
standards set by the math and science professional groups. Koretz himself 
later wrote that *\simple aggreg-ate [test] scores are not a sufficient basis for 
evaluating education.'''' Koretz correctly obsen'es that we camiot link test 
scores directly to effective or ineffective instniction and that test scores are 
subject to the influences of many nonschool factors. 

News media feed assumptions 

Richard Cohens comment reveals how deeply and tenaciouslv people 
hold the assumption of decline and how often this assun^ption tiniis up 
in media coverage of school performance. When Cohen wrote his column, 
he had known about rising test scores for almost two years. 

Other journalists continue the distressing diatribe on the condition of 
education. For example, the November 1992 issue of the Ameruwi School Board 
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JourmI carried a stoiT on the results of a 1992 international study of 31 na- 
tions. US. students tied for eighth overall. Yet the JourmFs headline stated 
"Good News: Our 9-Year-Olds Read Well. Bad News: Our 14-year-olds Don't." 
In a comparison of 31 nations, a 16th-place finish would be "average." How, 
then, can an eighth-place finish be "bad news?" (As you'll see in the next 
chapter, the realitv was that the scores of the ninth place 14-year-olds were 
quite close to first place.) Another example: In September 1993, C. Boyden 
C.ray and E\ an ]. Kemp declared. "Yet even America's best high school students, 
as international comparisons reveal, rank fkr behind students in countries 
challenging us in the multinational marketplace."'" This is not true, as well 
also see in the next chapter, but it still is a commonly held belief 

Finallv. an editorial in USA Today began with the contention that. "One 
report card after another Hunks U.S. schools." It then went on to approve 
of school management b\' profit-making companies, declaring that the situa- 
tion was so bad\hat "if it' takes something revolutionar> [to improve schools], 
then let's do it." 

Educators add to the problem 

Such sentiments can be found even inside the education community. In 
Juno andjulv of 1993 for example. Albert Shanker, president of the American 
Federation oi' Teachers, begim three consecutive Sunday '<ew York Times col- 
unms as follows: 

"The achievement of US. students in grades K-12 is veiT poor." 

"American students are performing at much lower levels than students in 
other industriali/.ed nations." 

"International examinations designed to compare students from all over the 
world usually show American students at or near the bottom." 

One can take issue with the first statement, and the remaining two are 
demonstrably lalse— although often made. 

Thus, the real progress educators and students have made has been cloud- 
ed by a fog of sometimes alarmist and oftentimes just faulty criticism. This 
is not to sav that public schooling in America has reached its pinnacle and 
need not impro\e. Hut. before examining what the system needs in the way 
of change, we must first take a quick look at how the system is performing 
cmrentlv. 
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CHAPTER TWO 

A Nation At Risk'* conjured up the specter of "a 
rising tide of mediocrity ' that threatened our 
economic and social well-being. A flood of reports 
followed that document, all seeming to confirm the 
dour view and dire warnings. 

But after the long night of the gloomy reports, 
a few researchers— sometimes at great risk to their 
reputations and their jobs— tried to assess the damage 
in a calmer fashion than the "Risk" authors. 

In independent studies, Iris Rotberg,^ Harold Hodgkinson,^ Richard 
Jaeger,^ Joseph Schneider and Paul Houston,'* David Berliner^ the Sandia 
engineers,^ and I all found: While there were indeed many problems calling— 
and sometimes screaming— for attention, the education system as a whole 
was functioning better than ever. Given the decay and decline in social insti- 
tutions surrounding the schools, such performance seemed, at the veiy least, 
amazing. 

Here are just some of the findings, based on data from 1990 lo 1993: 

• High school completion rates are high — about 86 percent.' 

• Conversely, dropout rates are low and have been declining over the last 
20 years for all groups except Hispanics, who have the highest dropout 
rate and a stable one." 

• College attendance has increased by 4 million to a record level of 15 
million— despite a steady decline in the number of high school seniors 
since 1977. About 58 percent of high school graduates now attend college, 
and another 10 percent enroll in some type of postsectmdary technical 
or vocational school. Major demographic changes in the college popula- 
tion have transpired, but often have gone largely overlooked: The average 
undergraduate is almost 25 years old, and only 62 percent of undergrads 
attend school full-time; minorities represent 30 percent of students taking 
the SAT.« 

These stiitistics on high school completion and college attendance would 
be of little interest if schools were doling out meaningless diplomas on the 
basis of "seat time' or ''social promotion," as some critics have claimed. But 
this is not what's happening. 

• Achievement test scores are up. Some are at all-time highs (see Figure 
2-A). Some of the rise can be attributed to increased attention to test scores 
by policy makers, the press, and the public. They have put a premium 



FIGURE 2-A 
Achievement Scores On the Rise 



Some achievement test scores are at all-time highs. The solid lines are 
trends for the Iowa Test of Basic Skills. The broken lines are trends for na- 
tional norming studies of the ITBS. Note that in several instances, national 
trend lines are above those for Iowa. 



COMPOSITE 
YEAR 

1955 1960 1965 1970 1975 1980 1985 1990 1995 



G 
R 
A 
D 
E 

E 
Q 
U 
I 

V 
A 

L 
E 
N 
T 

S 
C 
0 
R 
E 




KEY: 



Iowa Scores 



National Norming Scores 



Source. H.D. Hoover, Iowa Testing Programs, University of lova 



10 



20 



on high test scores, which, on occasion, has resulted in inappropriate 
attention to such scores. But some ot the increase appears to reflect real 
achievement.'^'-^' 

• SAT scores for all ethnic groups except whites have risen since the College 
Board began keeping data by ethnicity in 1975. As noted earlier, the ag- 
gregate average is more complex than it first seems. The overall SAT average 
looks as if it is falling, but this is an illusion. It's an event so common 
in mathematics that it has a name: Simpson's Paradox. Minority groups' 
scores have been rising, but their average scores still lag well behind those 
of whites. The pen^ent of minorities in the test-taking group has risen 
from about 8 percent in the mid-6()s to 30 percent in 199S. Adding this 
increased number of low but improving scores into the mix lowers the 
average. (The arithmetic of Simpsons paradox is simple and is illustrated 
as Figure 2-) at the end oi this chapter) 

FIGURE 2-B 

Trends in PSAT Norming Study Results 

While the SAT had a long period of decline, the a\erage SAf score is 
determined by whoever shows up on Saturday mornings to take the lest. 
National norming studies of the PSAT, a short \'ersi()n of the SAT, show no 
declines during the priod that the SAT average was falling. 
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• Scores on Advanced Placement tests have been stable, but the number 
of AP test-takers rose from 98,000 in 1978 to 413,939 in 1993, With such 
a deeper dig into the talent pool, one might well have expected scores 
to fall,*'^ but the decline has been small, from 3,16 to 3,00 on a five-point 
scale, 

• The percentage of graduates taking the College Board achievement test 
has been stable, and their scores are up over the last decade, as are their 
SAT scores,^ 

• At the univei sit) level, the number of students taking the Graduate Record 
Examination has increased in the last decade. Yet scores have risen on 
all three tests— verbal, mathematical, and analyticalJ^ 

• Scores on the National Assessment of Educational Progress (NAEP) reading, 
mathematics, and science tests are as good as or slightly better than 
their level at NAEP's ince})tl()n in 1969— except for the scores of 17-year- 
olds in science. The science scores of IV-year-olds have recovered more 
than half of the initial loss,'-* 

• Students know at least as much as their parents knew. In their study 
of students knowledge of American histor)' and literature, Diane Ravitch 
and (Chester Fimi awarded "Fs" to Iz-year-olds in both subjects,'^ However, 
Ravitch and Fiiui chose items that 50 percent of students fail on average. 
Then they set their pass-tail cut at 00 ]jercent correct, thereby guaranteeing 
a high failure rate. A more recent study by Dale Whittington of the Univer- 
sity of Akron found that today's students know at least as much as their 
parents and grandparents and, given the increa.sed high school completion 
rates today, i)r()l)ably more. In previous generations, those who knew less 
might well have dropped out of school by age 17,^" Furthei; a review of 
"then-and-now" studies of reading reported in Lilmify in America found 
no evidence of better reading performance at any time in the past,'^ 

• American 9-year-olds flnished second in a 1992 study of i*eading in\'olving 
2()(),(){)() students in ;51 coiuuries. American 14-year-()lds tied for eighth, 
and veiy close to first place''* I'he difference between the eighth-place 
American students &^:^) and the second-place French (549), for example, 
is only 14 poiuis on a OOO-point scale identical to that of the SAf. This 
difference is the same as the diflerence between aiid 549 on the SAT 
\'ei*bal (see Figinv 2-(l). 

RiUiks, h()we\er, are deceptive. They ohscme performance: When people, 
states, or nations are ranked, someone must rank last. Kven in the Olympic 
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FIGURE 2-C 
Second By a Nose 

A 1992 study of students in 31 nations found American y-ycar olds* 
second in the world in reading. American 14-year-olds finished ninth, in 
the top third, but with scores only three points farther out of first place 
than the 9-year-olds. The scores of 14-year-olds were tightly bunched together, 
meaning that a difference of a few points made a big difference in ranking. 
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* Ages actually ranged from 8 to 10. and from 14 to 15 respectively. Ages 9 and 14 are given as averages. 
Source: The Intemational Association for the Evaluation of Educational Achievement. July 1992. 
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100-meter dash, someone ranks last, although his peers likely do not call 
him "Pokey." If one looks at actual scores, the American 14-year-olds actually 
do almost as well as American 9-year-olds. American 9-year-olds finish 22 
points behind the first place Finns (569 vs. 547), American 14-year-olds, 25 
points back (560 vs. 535). 
• Students do not trail "far behind" students of other nations, as critics 
often allege. In the Second International Assessment of Educational Prog- 
ress (L\EP) in mathematics and science, American 9-year-olds finished 
third among students in 15 nations. In the other comparisons, American 
students did not rank high. But when one examines the actual scores, 
all four averages hover right at the international averages. 
The overall rankings and scores, however, are misleading. For example, 
of one disaggregates the data by ethnicity, a far different picture gets painted. 
Here is the top of the scale: 



Category Score 

Asian students, U.S. schools 287 

Taiwan 285 

Korea 283 

Advantaged urban students, U.S. schools 283 

White students, U.S. schools 277 

Hungary 277 



Since Asian and white students make up about 70 percent of U.S. students, 
it can be seen that the great majority of American students are competing 
well with students in the top foreign countries. Some students, however, are 
not faring as well in the competition. At the bottom of the scale we find this: 



Mississippi 246 

Jordan 246 

Hispanic students, U.S. schools 245 

Disiidvantaged urban students, U.S. schools 239 

Black students, U.S. schools 236 



Obviously, we have a big job to do with our lowest achieving groups. 
• America's "best" students outperform those of other developed nations. 

Analyses of the Second International Mathematics Study (SIMS) reveal 
that when American students are compared to Japanese students on 
mathematics that both have actually studied, Amcriam students outscore 
the Japanese substantially.^® (See figiue 2-D) That analysis compared 20 
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FIGURE 2-0 

United States and Japan: Top Students Compare Favorably 

American eighth-graders actually taking algebra compare favorably to 
either the entire class of Japanese eighth-graders or the top 20 percent of 
Japanese eighth-graders. The very best of American students score much better 
than the very best of the Japanese top 20 percent while the lov^est performing 
Americans are much worse than their Japanese counterparts. 
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Source: Westbury, Educational Researcher, June-July 199? 

Box-plots displaying ranges of American pre-algebra and algebra achievement 
and the range of achievement of the top quintile of the Japanese sample. 
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percent of Anieriain eighth-graders (presumably the academically most 
able 20 percent) to KK) percent of Japanese eighth-gmders, A second 
analysis cxan)iiied the relative scores of the American students with the 
top 20 percent of Japanese students— the American students still scored 
higher, although the difference was quite small. However, within this select 
20 percent, the toj) 5 percent of American students scored well above 
the top 5 percent of Japanese students, 

• Students in the top 50 percent of American classes scored as well or 
better than Japanese students in the top half of Japanese classes on SIMS 
mathematics tests:' However, while Japanese students in the lower half 
of Japanese classes do not tniil their upper 50 percent peers by too much, 
American students in the lower half of American classes score much worse 
than their Japanese counterparts and much worse than American students 
in the top 50 jxMrcnt of American classes, (Again, the dreaiy performance 
()f,\mcrican students in the lower echelons of achievement is an important 
consideration for reform, lis a threat to their well-being and the nations, 
and will be discussed at length later,) 

Similarly, an examination of scores on the second lAEP shows almost 
all countries tightly bunched together at the upper levels of performance.^'^^^ 
The differences in scores are so small that ranks distort and exaggerate the 
differences among nations. For example, the top 5 percent of Korean 13-year- 
olds, who had the highest avenige score, scored % on the science test. The 
toj) 5 j)erccnt of American students, who ranked a mere thirteenth, scored 
92, Because the countries are close together in terms of scores, a few points 
difference in scores makes a large difference in ranks. But the score difl'erentials 
are hardly sufficient to cieate a crisis of confidence in our educational system. 

• The number and proportion of students scoring above 650 on the verbal 
or niatheniatics section of the vSAT has not declined in the last decade, 
as the nation's **K(iucati()n \ews])aper of Record," Education Week declared 
in (See Figure 2-K.) The number and proportion on the verbal 
section are both the same oxer the last 10 years, and both the number 
and pn)porti()n of high scorers on the mathematics section have risen, 
Kleven jx'irent of current test takers score 050 or better on the SAT 

mathematics section, up from 7 peixent a decade ago. Oiven that statisticians 
forced a not nial cune on SAT scores wIkmi the standards were set in 1941, 
this ixpresents a large increase, (It is in the nature of normal cuitcs that 
not many people score at the extremes,) On the SAf, 050 is one and one-half 
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FIGURE 2-E 

High Performers' Scores Misreported 

Although Education Week reported that "in the last decade, both th ' number 
and proportion of students scoring above 650 on the SAT verbal or mathematics 
has declined," the number on both tests has increased. The proportion has 
increased enormously on the SAT math. Education Week inadvertently reported 
only the scores for students scoring between 650 and 690, omitting all those 
who scored between 700 and 800, the highest possible score. 
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standard deviations above the mean. When the standards were set, using 
an almost all-male, almost all-white elite in the Northeast, only 6.63 percent 
of them topped the 650 mark. From 1992 to 1993, the number of students 
scoring above 650 rose by 2300 on the SAT verbal and 5,600 on the vSAT 
mathematics. The total number of test-takers rose by 10,000. The increases 
in high scorers are thus disproportionately large compared to the increases 
overall. For the mathematics section, the percent of students scoring above 
650 is at an all-time high. 

High scoring Asian immigrants cannot account for the increase in the 
number of high scorers. Although Asians do, indeed, score much higher 
than other ethnic groups in mathematics (but not in verbal), they represent 
only 8 percent of all test-takers — far too small a number to produce the 
change. The results from 1993 show over 110,000 students with an SAT 
mathematics of 650 or better, and only 83,000 Asians in the entire sample 
of just over 1,044,000 students. 

• The longstanding prediction of a shortage of scientists has never devel- 
oped, nor will it. The prediction was based on faulty assumptions It 
is now seen in some quarters as a cynical ploy to get more federal funds 
directed to science. We have, in fact, a surplus of scientists. This surplus 
is likely to grow as the defense establishment shrinks. (One-third of American 
scientists and engineers currently work for the Pentagon.) As it is, The 
Netu York Times reported in 1992 that 12 percent of those receiving doc- 
torates in physics in 1991 received zero job offers.^^ Another 50 percent 
received only one. 

^^Perspectives on Education in America,'* the Sandia Report, found Americans 
obtaining technical and scientific degrees at record rates, even taking into 
account the percentage of those degrees going to persons from other nations 
(many of whom remain here, adding a significant amount of intellectual 
capital to this country).^*^ 

• The United States already is either number one in math and science— as 
called for in the National Education Goals— or is very close. Of course, 
this is true only if you define number one in terms other than within 
the narrow confines of multiple choice test scores. 

For example, the Unilcd States has more engineers per 10,000 workers 
(184) than any other nation except Japan (188). The former West Germany 
has 182, and then the numbers drop off quite sharply for other developed 
nations.^' Similarly, scientists, engineers, and mathematicians in the United 



States account for about 27 percent of all publications in research journals?® 
This is more than triple the percent of the three second-place finishers— Japan, 
the United Kingdom, and the former Soviet Union, These numbers have 
been stable since at least 1973. 



Achievement Up Despite Social Decline 

As noted earlier in this chapter, the accomplishments cited are even more 
remarkable when put in the context of a declining social fabric. The decline 
can be seen in a variety of statistics: 

• Some 20 percent of American children live in poverty, even after social 
programs are taken into account. This compares to 9 percent in Canada, 
8 percent in the United Kingdom, 5 percent in France and 3 percent 
in the former West Germany.^^ (See Figure 2-F) Children who live in 
poverty do not perform well, even if they get good grades in school. Students 
in low poverty schools who get As score at the 87th percentile on a standar- 
dized test. Students in high poverty schools who get As score at the 36th 
percentile. Students in high poverty schools who get As do not score 
as well as students in low poverty schools who get C's.^^ (See Figure 2-G.) 
(In this study, a high poverty school was defined as one with 76 percent 
or more students eligible for free and reduced lunch. Low poverty schools 
had a 0-20 percent eligibility.) 

Poverty's impact on education surpasses that of ethnicity. An analysis 
of math test scores by ethnicity and socioeconomic status shows the usual 
trends for different groups with blacks scoring lowest, then Hispanics, whites, 
and Asians. But looking at the top and bottom 25 percent in terms of 
socioeconomic status, poor Asians do not do as well as wealthy blacks. 

It should also be noted that poverty affects more than test scores. Although 
students who drop out of school give a variety of reasons, poverty is a common 
one. 

• Fewer than 50 percent of US. children receive the immunizations they 
need to ensure their early years are free of common childhood diseases. 
Five percent of these children were born with preventable handicaps (In 
Europe, percentages range from 80 to 95 percent.).^^ 

• The United States ranks nineteenth in the world for both infant mortality 
and low birth weight deliveries,^^ Low birth weight children are much 
more likely to repeat a grade, fail in school, or end up in special education 
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FIGURE 2-F 

Percentage of Children Living in Poverty 
in Industrialized Nations: 1991 

The United States has more than twice as many children living in poverty 
as other developed nations. While the United Kingdom has a greater propor- 
tion (using only raw numbers), once welfere programs are taken into account, 
the proportion there fells to less than half that of the United States, 




Source: Education W6ek, September 29, 1993 



FIGURE 2-6 
Poverty and Performance 



Letter grades in high poverty schools may mask low achievement. Students 
who receive A's in mathematics in high poverty schools do not score as well 
as students who receive Cs in low poverty schools. High poverty schools 
in this instance are defined as schools with at least 76 percent of students 
eligible for free- and reduced-price lunch. Low poverty schools have 0-20 
percent eligibility, 

7th-Graders' Percentile Test Scores by Course Grades; 
Low and High Poverty Schools, 1991 
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Source: Prospects (Abt Associates, 1993); Education Week, June 9, 1993. 
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than are normal birth weight children. The lower the weight, the greater 
the risk. 

• A rising proportion of children live vnth one parent. While the effects 
of single parenting are complex, we know that test scores correlate with 
the percent of children living with a single parent: the higher the per- 
centage, the lower the scores.^^ 

• Crime is posing a bigger threat Stories concerning children bringing 
guns to school — and sometimes using them — are on the increase. The 
cover of a September 1993 issue of the New Yorkei' presented a chilling 
impression of children arriving for the first day of school. Each carried 
a lunch box and an assault rifle. 

Sadly, the fastest growing segment of the population is the incarcerated. 
Despite increasing numbers of early releases and the use of electronic trackers 
to keep surveillance on prisoners out of jail, the prison population of Maryland 
increased 250 percent between 1980 and 1992, for example. There is no indi- 
cation that Maryland's statistics are anomalous among states?"* 

U.S. Index of Social Health at all^ime low 

The Index of Social Health, sometimes refeired to as the '*Dow Jones 
of the Soul,'' permits us to see these trends in a single figure. Published annually 
by the Institute for Innovation in Social Policy at Fordham University, the 
Index combines 17 social indicators such as infant mortality rate, poverty 
rate, food stamp rate, and homicide rate into a single number that takes 
on values between 0 and lOO.^** The Index peaked at 72 in 1977, then plummeted 
to an all-time low of 50 in 1990, the last year for which numbers are available. 
The index contains only one education indicator, the dropout rate. During 
the period mentioned, this rate has been stable or improving. The schools 
are not dragging the Index down (see Figure 2-H). 

Objective, Systemic Approach Needed 

The statistics presented in this chapter lead to the conclusion that previous 
examinations of schools, especially "A Nation At Risk*' have failed to take 
into account many of the subtleties in the data. It also reveals that the social 
context in which schools function is declining, something also omitted in 
"Risk" and many other analyses. To obtain a clear idea of what needs to 
be done and how re(|uires a comprehensive approach to examining both 




FIGURE 2-H 

Index of Social Health of the US., 1970-1989 



Fordham University's Index of Social Health has shown a steady decline 
since 1976. The Index combines rates for infant mortaHty, child abuse, children 
in poverty, teen suicide, drug abuse, high school dropouts, unemployment, 
poverty among heads of household, health insurance gaps, unemployment 
insurance gaps, poverty of people over 65, out-of-pocket health costs for people 
over 65, homicide, highway deaths due to alcoholism, food stiimp gaps, gaps 
between rich and poor, and lack of affordable housing into a single index 
that can vaty from 0 to 100. The dropout rate, the only education indicator 
in the Index, has been improving during the period the Index has been published. 
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schools and the institutions surrounding and affecting them. Only such a 
comprehensive, systems approach can be expected to accomplish what needs 
to be done. 



Keep outlook positive 

In taking a systemic view, perhaps the first step for school leaders is to 
recognize and refute the pervasive mind-set of school failure. The assumption 
of school failure leads people to accept data corroborating the failure un- 
critically, and to ignore or distort information such as that presented in this 
chapter. Just one example: In 1993, Harvard professor Katherine Merseth 
declared that: 

Effort receives little credit for contributing to successful learning 
in mathematics— or, for that matter, in any subject. For example, 
American, Japanese, and Chinese mothers were asked what factors 
among ability, effort, task difficulty, and luck made their children 
successful in school. American mothers ranked ability the highest, 
while Asian mothers gave high marks to effort.^® 
Merseth's statement is false, but it is widely believed. Merseth is only one 
of many people who have mouthed this apparent verity, and she is quoted 
only because her citation is convenient — not because it is unusual. Harold 
Stevenson, who produced the data that Merseth was working from, has 
perpetrated this untruth in many articles. Merseth simply accepted what Stevenson 
said without looking carefully enough at the graphs. 

In fact, Stevenson's own data show that it is not true.^^ It is tme that American 
mothers rank ability as more important than Asian mothers do. But it is 
also true that American mothers rank effort as more important than ability 
(see Figure 2-1). They believe it is almost as important as Asian mothers 
do. American children show the same pattern: They give more importance 
to ability than A.sian kids, but rank effort as more important than ability 
and almost as important as Asian children rank it. 

Since good data drive systemic management and change, we must en- 
courage very close, objective examinations of any and all reports on the per- 
formance of American students. With solid knowledge of how the system 
performs, wc can start to examine the nature of the system and its needs. 
First however, wc need to describe why a systems approach is needed. 



24 



FIGURE 2-1 
Effort Is Important 

From the work of Harold Stevenson and colleagues, many people have 
concluded that American students and their mothers believe that good school 
performance comes from ability, while Asian students and their mothers believe 
it comes from effort. A close look at the graphs from The Learning Gap shows 
that this is not true. Ameiican students and mothei"s both rate effort as more 
important than ability. And, they value effort almost as highly as do Asian 
mothers and their children. 




Effort Ability Task Difficulty Luck 



Source: The Learning Gap, 1992 



FIGURE 2-J 

The Arithmetic of Simpson's Paradox 
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500 
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10. 


400 


430 


Total: 


4900 


4860 


Average: 


490 


486 



These two columns of numbers represent SAT scores for purposes of 
explanation. (See p. 11 of this book.) Assume that column A represents the 
SAT scores for test takers in one year. Assume further that the 500's all come 
irom one ethnic group and the 400 from another. The overall average is 
490 ( (9 X 500) + 1 X 400)/ 10. Assume that Column B represents the SAT scores 
of the same two ethnic groups some years later. The scores of the first have 
risen from 500 to 510 and the scores of the second from 400 to 430. However, 
whereas the second ethnic group constitutes 10% of the test takers in Column 
A, in Column B the second ethnic group represents 30% of the test takers. 
Their scores, while rising faster than those of the first ethnic group, remain 
below those of that first group. Thus, adding more diversity into the overall 
average lowers it from 490 in Column A to 486 in Column B. This is essentially 
what has happened to SAT scores and ethnic composition since 1975. 
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CHAPTER THREE 



THE NEED 
FpR A 
SYSTEMS 
APPROACH 



For a complete understanding of American educa- 
tion—and certainly before one passes judgment 
on it— one needs to examine the entire system from 
pre-kindergarlen to post-graduate school. Only such 
a view presents the entire picture. 

Without a view of the whole system, policies and 
programs may well turn out to be misdirected or pro- 
duce unforeseen effects. As we have learned from the 
science of ecology: A stress in one part of the system 

often produces results in another part of the system— results that can surprise 
unless the system is well understood. The emerging science of chaos uses 
a telling analogy about the interdependence of events in a system known 
as "the butterfly effect^': A butterfly fluttering over Tokyo affects the weather 
in New York,' 

Systems Thinking Not the Norm 

Many Americans are not used to thinking in systems terms. Our intellectual 
tradition is one of analysis, of breaking things apart into component element's. 
Our heritage from both the British Empiricist philosophers and from American 
experimental psychology— monopolized until recently by atomistic 
behaviorism— emphasizes breaking complex matters into simple parts. In re- 
cent years, education has been strongly influenced, perhaps dominated, by 
a back-to-basics approach that viev^'S complex skills merely as accretions of 
simple skills. While Bloom s hierarchy places synthesis beyond analysis, analysis 
pervades our approach to most issues and topics. (Has anyone ever heard 
of a television commentator referred to as a "news synthesist?'') 

As a consequence of these twin legacies from philosophy and psychology, 
most education writers and reformers have not taken such a systems view. 
Most commentaries have not only limited their range to the K-12 component 
of the system, they have focused narrowly on only a few of the grades within 
that component. Most international comparisons, for example, have procured 
data only from grades 4 and 8. This is an understandable approach because 
in many countries a substantial portion of the population leaves school after 
the eighth grade, or the system becomes rigidly ti*acked and provides different 
groups with noncomparable instruction. 

Studies that have tried to examine performance in the twelfth grade have 
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been fatally flawed. This is so not only because of the stark differences in 
percentage of students in school, but also because of the even starker differing 
percentages of students in various kinds of courses. For example, the Second 
International Mathematics Study found Hong Kong students in the middle 
of the pack in eighth grade and nearly number one by grade 12. By contrast, 
students in Hungary were number one in the eighth grade, and had fallen 
to below average. These data could reflect that Hong Kong's secondary schools 
are the best in the world and that Hungary's system slips badly after middle 
school. It is more likely, however, that the numbers turn out the way they 
did because only 3 percent of Hong Kong's students were in mathematics 
at grade twelve, while nearly 50 percent of Hungary's students were. Accomplish- 
ment in mathematics is a source of national pride in Hungary and it keeps 
many more students in math programs longer than in other nations. 

As an aside, virtually no one in the United States attempts to test seniors— 
apparently for good reason. Those that have tried have found answer sheets 
blank or filled in with designs. It appears that those working on the New 
Standards project and others interested in assessing educational outcomes 
are unaware of this foible of American students. Harold Stevenson and James 
Stigler's book. The Learning Gap, is just one example of prominent US. Studies 
being piecemeal. The cover of the book reads, in its entirety, **Why Our Schools 
Are Failing and What We Can Learn from Japanese and Chinese Education."^ 
One would expect (or hope), then, that the authors had looked at the entire 
system But The Learning Gap contains achievement data from studies looking 
at test scores mostly in mathematics and only in grades 1 and 5! It also is 
important to note that these studies suffer methodological, sampling, and 
cultural flaws which render them essentially meaningless. 

Why a Systems Approach Is Needed 

As indicated by the discussion in chapter 2 on the Index of Social Health, 
the educational system is part of a larger social system. It cannot be understood 
apart from that larger system, which is sometimes considered the context of 
the educational system. 

Some have argued that this larger system should be ignored, that educators 
should simply take responsibility for what they have in their purview. To 
consider the social context, they claim, is to make excuses for education's 
poor performance and low productivity. Would that it were this simple. 

"sT Rx " 



Focusing on the larger system and its context, indeed, risks missing some 
problems. It is the risk illustrated by the old stor)' warning about the dangers 
in the use of local norms: A middle-aged man enters a doctor's office and 
says, **Doc, Fm only sleeping two hours a night. Am I normal?" Before answer- 
ing, the doctor asks for more information. The man reveals he sips vocika 
all day and chugs a half pint of Scotch whiskey before going to bed. He's 
just been fired and his wife has left him. Finally the doctor answers, "Yes, 
for a 50-year-old jobless alcoholic going through a divorce, you're normal." 
Similarly, some school systems with problems camouflage or ignore them 
by comparing themselves, on test scores, say, with similar systems. 

Currently, there is talk of "adjusting ' NAEP state scores to compensate 
for differences in parental education levels, ethnicity mixes, poverty, etc. While 
this sounds reasonable, it presents the same problem as the 50-year-old alcoholic: 
States that don t have a student body representative of the nation as a whole 
have to face that fact. Indeed, a recent report from the Educational Research 
SeiA'ice finds that 89 percent of the variability in state-level NAEP mathematics 
scores is accounted for by parental education, number of parents at home, 
community type and state poverty rates for ages 5-17. The authors argue 
that in the face of this, NAEP state scores are a good index of the difficulty 
of the educational task facing those states. 

Analyses made in a vacuum often are incorrect 

On the other hand, to examine only the school system without its context 
is similar to trying to judge the perfonnance of an air-driven engine in a 
vacuum. It leads to incomplete or erroneous analyses and prescriptions. For 
example, Denis Doyle of the Hudson Institute alleges that the United States 
has a productivity crisis in education: Funding for education in real dollars 
rose 34 percent between 1982 and 1992, but test scores for that period were 
stagnant.^ Challenged on the stationary nature of test scores, Doyle said that 
the "important'* scores, those on the SAT, were flat. The link between expendi- 
tures and changes in test scores, especially changes in the SAT, is indirect, 
but the example indicates the problems inherent in not taking the broad view. 

To shift from a mechanical metaphor of the engine to a more appropriate 
biological analog\\ the schools and the social institutions surrounding them 
really make up only one ecosystem in the long run. We need to know how 
the environment of the schools afTects schools. About three years ago, Harpers 
editor Lewis l^apham reflected this sentiment when he wondered how on 
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earth we could expect the schools to promote values and activities that were 
rarely found in the rest of society: "Children learn by example as well as 
by precept, and they have only to look at Times Square and Disneyland— or 
to consider the triumphs of individuals as culturally bereft as [former] Presi- 
dent George Bush, Madonna, Bob Hope, and Donald Trump— to know that 
as a nation we care as little about the arts and humanities as we care about 
the color of the rain in Tashkent."* As the title of Harold Hodgkinson^s 1985 
publication attests, ultimately it is all one system? 

''Quick fixes" can cause even more problems 

As noted, the discipline of ecology suggests that one tinkers with a part 
of a system in isolation at one's peril. The ecological perspective— that a 
change in the system at one point has ramifications, sometimes hard-to-predict 
ramifications, at other, distant points in the system— should have taught us 
to move slowly and systematically. 

The ecological perspective, however, clashes against two strongly ingrained 
American solution tendencies: toward the short-term, quick fix and toward 
a one-problem, one-solution approach to problem solving. Research shows 
that school children learn to look for the solution to any problem. In science, 
laboratory "experiments" often guide them directly to the solution and offer 
no challenge to their reasoning or problem-solving capabilities. In math, 
they learn that any problem can be solved in five minutes because that's 
all the teacher gives them.^ In fact, many real-world problems have multiple 
solutions that may be equally efficacious. 

These flaws in the typical American approach to solving social problems 
are compounded by the tendency to make what sociologist Philip Slater termed 
"the toilet assumption."" Once we flush the toilet, we think we're done with 
the problem. We have no conscious thought that it still exists somewhere 
else in the system. Lacking a systems perspective, we are surprised and angry 
when, on occasion, it backs up. Having "solved" a problem, we feel, wrongly, 
thai we need not attend to it further. 

Nonsystemic reform doesn't yield desired results 

Similarly, much reform, even well-intended reform, has failed to produce 
the intended outcomes because it has focused only on one group of students 
or one program. Chapter 1, Head Start, PL-94.142, all addressed worthy goals. 
But the problem with, say. Head Start, is that for many children it comes 
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after five years of Bad Start. Ernest Boyer in Ready To Leamf does trace readi- 
ness problems back as far as the mother's pregnancy. But his is a work directed 
to one element, the first National Education Goal, and is not a complete 
systems approach. Somewhere this efiFort must be coupled with components 
of the program that precede and follow the activities and ages addressed 
by Boyer. We must ask why is it that children are entering school today less 
ready to learn, and what can we do about it? 

The Key School What has happened with the Key School in Indianapolis 
is a good example of the results of nonsystemic reform. A group of teachers, 
charged with developing a curriculum for gifted and talented elementary 
students, concluded that a curriculum based on Howard Gardner's theories 
of multiple intelligence in Frames of Mind^"^ would form an appropriate cur- 
riculum for all children. Unable to persuade the other teachers to their view, 
these teachers eventually established a new school known as the Key School, 
a magnet school within the Indianapolis Public Schools with an ethnic mix 
identical to that of the whole system. 

In the five years of Key School's existence, it has drawn perhaps the most 
ardent and sustained positive attention from the media and from educators 
around the country of any school in the nation. (As discussed later, however, 
little interest has been shown about it in Indianapolis— another aspect of 
the system that needs attention. Elsewhere I have labeled this aspect, "the 
pathology of envy!')** 

Wliile the Key School attempts to teach to each child's strengths and 
weaknesses, all children learn a foreign language and all learn to play a musical 
instrument. All children take fine arts daily. Teachers teach, in part, about 
things that interest them in the outside world on the (accurate) assumption 
that topics that genuinely interest teachers also will interest the children. 
The curriculum isn't organized around the usual discrete topics, but around 
large themes that cut across curricular areas. 

Each Wednesday, while the teachers evaluate what is going on and plan 
what to do next ("next" may be tomorrow, next week, next term, or next 
year, depending on circumstances), members of the community such as sym- 
phony orchestra players or paramedics gather with the children in the auditorium 
and talk about their professions. 

It sounds wonderful, and the mood and body language of the children 
suggest it really is. But at the end of the sixth grade, the world of the Key 
School ends and reports have come back that the kids "die" on confronting 



a standard middle school. No one thought about this at the beginning. The 
elementary teachers were consumed initially with constructing an elementary 
school. Happily, in the fall of 1993, the Key School began a three-year expan- 
sion to become a K-12 environment. In addition, the high school will contain 
experiences in the community that will, one hopes, articulate with college 
and work. 

Most people in school buildings do not have the extended vision of the 
Key School teachers, as they did not initially. Elementary teachers tend not 
to worry about events after sixth grade; middle school teachers aren't con- 
cerned with eleventh grade, and high school teachers don't trust the judgments 
about students made by middle school teachers. Most high school teachers 
do not show students A papers (and other graded examples) from universities. 
They do not take their students' papers to be graded at a university. Nor 
do they talk with business people or Army recruiters about what their non- 
college-bound students need after high school. No one looks at the whole 
picture. Someone should. 

CalifomiaV. curriculum frameworks. Yet another example is the state of 
California's efforts to design more cogent curriculum frameworks, which have 
received high marks in most quarters. In constructing the frameworks, the 
state educators drew on some of the best professional thinking in the various 
subject areas. Yet when David Cohen and his colleagues at Michigan State 
University examined how these frameworks were being implemented, they 
found a fundamental breakdown in the process.^^ 

The state had developed fine frameworks, but provided little or no staff 
development to help teachers understand them. Left to their own interpreta- 
tions, teachers differed wildly on what the frameworks meant and what they 
implied for their own teaching practice. Some thought, wrongly, that the 
frameworks simply meant they should do more of what they were already 
doing. Others did not see that their teaching practice directly contradicted 
the assumptions girding the frameworks. 

The situation in California is surely an improvement over the days in 
which curriculum materials were designed to be "teacher proof;' or the more 
recent "conspiracy of good intentions" that produced bland, dull textbooks. 
But it still reflects the problems that occur when designers of the system 
do not involve the users of the system. 
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Need beginning to be realized 

It has not always been well understood that failing to focus on the whole 
system jeopardizes reform. Indeed, one of the conclusions of the RAND Cor- 
poration's four-yeai; eight-volume study of educational change pul)lished in 
the mid-7()s was that comprehensive, systemwide change efforts were likely 
to fail.*^ But when Milbrey McLuighlin, a senioi' author of the study, levisited 
its conclusions in 1990, she determined that w^s one conclusion that had 
been wrong (lai^gely because of the kind of leform effort that was studied): 
One implication [of this re-examination] is that special projects, 
or reforms aimed at disci*ete elements of the education {)olicT system, 
are likely to be disappointing. The dominance of local implementa- 
tion, the local factors that make variability the nilc, and the fluid 
and often unpredictable chanicter of the local institutional environ- 
ment all underscore the systemic nature of the problems that change 
agent policies address. Special projects focused on single issues or 
single inputs typically (by necessity) ignore the systemic and intercon- 
nected conditions that influence classroom practice,^'* 
McUuighlin could have added that change focused only on single pro- 
grams is also likely to fail. 

Now it is better understood that attention to the entire system must go 
well beyond simply spaiuiing the age range within schools, or considering 
all players within the school setting. It must include the other social agencies 
that help children grow and develop. 

Some conseiA'ative school critics And ii*ony in the interest in consolidating 
education and other social agencies only a few years after the split up of 
the US. Department ol* Health, Education and Welfare. The appointment 
of a person from higher education as US. Sccretan- of Health and Human 
Ser\ices may have signaled, in part, a desire to align the two secretariats 
more closely. More importantly, in the fall of 1993, speeches by both PresideiU 
(llinton and US. Secrelan* of Kducation Richard Riley indicated an awareness 
of the intercoiuiectedness of various senice agencies and education. 

It seems likely that taking a systems view of the schools and their contexts 
could produce a higher performing system than the one presently in place. 
(Consider just a few of the current system characteristics: 

• Several hundred to several thousand children in one building. 

• Attendance foi' Ave days a week, thi^^e to six hours a day. 

• (Classes of 15 to 35 students. 
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• Classes with one adult. 

• Books, blackboards, workbooks, worksheets and, occasionally, workbenches, 
computers, and laboratories. 

• A standard curriculum, at the elementary grades at least, established by 
some authority above the district. 

• An emphasis on decontextualized, formal skills. 

Does anyone think for a moment that such a "system" maximizes how 
much children can learn? 

When Lauren Resnick studied 'Learning In School and Out," she found 
little resemblance between what happens in schools and what happens in 
other settings.*^ People have long spoken of a difference between "book 
learnin*[sic]** and "the real world," but in previous times they viewed the ap- 
parent estrangement pretty much simply as the way things were. Now they 
find such a poor articulation undesirable. Some people have realized that 
to separate "to know" from "to do," a segmentation much deplored by Dewey, 
is to produce an educational system that concentrates too much attention 
to what Alfred North Whitehead called "inert knowledge." Students spend 
too much time learning about isolated topics and too little time learning 
how to use that knowledge, a problem discussed in more detail in Chapter 4. 

Surely we can develop a better, more functional system that provides a 
more useful, integrated education— one that better articulates the relationship 
between school and adult/work situations, and makes it even seamless. The 
nature of many jobs is changing and the cira^^ges have major implications 
for schools, if we do not examine the relationship of the schools to the rest 
of the system, we will miss a vital link and likely go astray. 
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CHAPTER FOUR 



HOW PEOPLE: 
LEARN AND 
WHY IT'S . 
IMPORTANT 
TO KNOW 



The central elements in the educational system are 
the learners. We say "learners" rather than "learner" 
deliberately: While both American psychology and 
education historically have focused on individual 
abilities, achievements, and styles, recent evidence 
strongly impels the conclusion that cooperative and 
collaborative learning are more powerful than tradi- 
tional, individual, isolated learning. The focus on 
learners is determined by multiple forces in interna- 
tional competition, by societal values, and by findings in cognitive psychology. 

Some might contend that education has always focused on plural learners 
but, historically, this would not be tme. Nor, until recently, did education 
focus on even a learner with the intensity now demonstrated. For most of 
American public education s histoiy, it has not been forced to consider how 
to optimize learning. Expectations for schools were not always high. 

While economic and social factors push for more education, the revolution 
in thinking about thinking and learning causes us to focus on the nature 
of learning in schools and out. Many of the ideas have emerged from highly 
theoretical and esoteric notions of what it means to think and learn, as well 
as from the arcane field of artificial intelligence. Yet many of these ideas 
can be well expressed in everyday English— as shown by Deborah Meier, prin- 
cipal of Central Park East Secondar)' School in East Harlem, in the summer 
1992 Teachers College Record: 

Human beings are by nature social, interactive learners. We check 
out our idoas, argue with authors, bounce issues back and forth, ask 
friends to read our early drafts, talk together after seeing a movie, 
pass on books we have loved, attend meetings and argue out our 
ideas, share stories and gossip that extend our understanding of ourselves 
and others. Talk lies at the heart of our lives.' 



History of Thought Clouds Learning Theory Today 

This view of learning is more prevalent now than in decades past, but it 
still is not universally accepted. The reasons have to do with the intellectual 
histoiy of educational and psychological research. Although seldom men- 
tioned by name, the British Empiricist philosophers such as John Eocke, Bishop 
Berkeley, David Hume, and James and John Stuart Mill hang over American 



thought about thinking like a shroud, James MilFs theory of Mental Mechanics, 
in particular, resonates in the common view of learning. 

Mental mechanics undergird basic sl(ills approach 

Mental Mechanics held that the idea of '*house" is no more than the 
sum of the ideas of bricks, mortar, lumber, and nails. In the view of many 
today, complex knowledge is no more than the simple accretion of "basic 
skills** that must be learned before attacking more complicated work. A study 
by Lorrie Shepard of the University of Colorado found that most people 
working in the field of educational testing held such a theory of knowledge 
explicitly or implicitly? In their view, complicated knowledge could be '*decom- 
posed" into the "building blocks ' that corresponded to basic skills. The recur- 
ring call for "back to basics'* among policy makers and lay persons alike 
reflects such a theory. 

In addition to their theory of how knowledge accrues, the Empiricists 
established a powerful tradition in American philosophy and psychology by 
arguing that all knowledge comes from external sources, entering the brain 
from the senses. "Nihil est in intellectu quod non fuerit in sensu*' wrote 
Locke: Nothing is in the mind that did not come from the senses. 

Rationalists stress logic vs. sensory learning 

While the British Empiricists were busy reducing complex ideas to simple 
ones, the Continental Rationalists of Europe such as Descartes and Leibniz 
were independently inventing calculus and other mathematical fields and 
establishing a far different approach to the study of mental phenomena. 
Contrary to the British emphasis on sensory impressions, the Rationalist view 
emphasized introspection and logic to understand the mind. Thought pro- 
cesses were the ultimate analytic tool. "Cogito ergo sum** wrote Descartes: 
I think, therefore I am. 

Eventually, a compromise between the two extremes was formulated. In 
response to Lockes comment about nothing being in the mind that was 
not first in the senses, Leibniz responded, "Nihil intellectus ipse*-nothing 
but the mind itself Following the works of both Leibniz and Hume, Immanuel 
Kant laid down the organizing principles by which the brain a priori imposes 
order on the information coming in from the senses. Thanking Huine for 
waking him from his "rationalistic slumbers,*' Kant still showed that Humes 
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so-called pure empiricism actually required a mind that actively organizes 
thinking in certain predetermined ways. 

Today we would say that the brain imposes this order innately. In current 
parlance, we would probably say that the brain is "hardwired" to behave 
this way. For example, Hume had aigued that we acquire our idea of causality 
by repeatedly seeing event A followed at a certain time by event B. If the 
two events always occur in sequence and with the right timing, we come 
to conclude that A causes B. For example, a billiard ball (A) struck with 
a cue hits another billiard ball (B) and the second billiard ball moves. We 
say that A caused B to move. Hume thought it was purely the repeated ex- 
perience of such sequencing that produced the perception of cause and effect. 
But Kant showed that it was possible to design a mind whereby B following 
A would leave no impression at all. The mind must be predisposed to impose 
this categor)' of thought on events. 

Researchers Adopt Psychology Model 

Both the British Empiricists and Continental Rationalists figured largely in 
the early development of psycholog)', especially physiological psychology, but 
later the Empiricists won the day temporc.rily. It is only a short leap from 
the British Empiricist philosophers to the American behaviorists such as 
Watson, Hull, and Skinner who dominated thinking in the field from the 
1930s to the 1960s. The history- of psychology^ is critical to understanding 
the nature of educational research because educational researchers, and e( icators 
generally, took psychology rather than sociology- or anthropology as the model 
for educational research to emulate. 

One Swiss psychologist, Jean Piaget, who referred to himself occasionally 
as "an empirical Kantian" and always as a genetic epistemologist, did enjoy a 
period of popularity here in the 1 93()s before being swamped by the behaviorists. 
His popularity returned in the 1960s as the overblown behaviorist learning 
theories waned. **Nevcr have so many worked so hard to learn so little," said 
one Clhurchill-inspired wag of the grand theories and their followers. 

Piaget was actually an epistemologist— one who studies knowledge. Early 
in his career, he concluded that in order to understand the nature of knowledge 
in adults, one must understand how it develops from the earliest days of 
life. He thus studied infants (his own, initially) for periods of years. 

Piaget decided that while children's thinking is qualitatively different from 
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adults, the processes that children and adults use are identical. When something 
happens that we have experienced many times before, it has no impact. We 
''assimilate" it. When something diverges from our experience, we attempt 
to "accommodate" it, changing what is in our heads to fit the new event, 
but also adapting the new e\^nt to fit what is already in our heads. If the 
event is too far removed from our range of accommodation, we ignore it 
or, as some research suggests, become anxious. In all instances, acquiring 
knowledge is an active process, not a passive one. 

Constructivist view of learning dominates 

Although Piaget's specific theories are little discussed among contem- 
poraiy cognitive psychologists, his general view has claimed the day in the 
theorizing of American psychologists. Most psychologists now accept a "con- 
structivist" \'iew of cognition— holding that people actively strive to make 
sense of what is going on. In this meaning-making activity, they tiy to fit 
what is happening to them now to the knowledge already in their heads. 

A simple experiment serves to illustrate how what we understand depends 
on what we already know. Consider this passage: 

The batters were merciless against the bowlers. The bowlers placed 

their man in slips and covers, but to no avail. The batsman hit one 

four after another with an occasional six. Not once did a ball look 

like it would hit the stumps or be caught. 

Most American adults have no difficulty reading the words of this paragraph. 
They can decode the passage easily. It poses no unfamiliar or difficult terms, 
nor complicated syntax. For most, however, it also offei s virtuall)' no meaning. 
Most Americans simph- lack the requisite experience to allow them to fit 
it into their heads. Yet any youngster in Great Britain, Hong Kong, or Australia 
could decipher it at once: It is an Australian newspaper account of a cricket 
match. 

\\-c need not rely on formal experiments to see these kinds of thought 
processes in action: Anyone who has ever spoken to an audience of any size, 
or held a staff meeting, knows fi*om the questions asked that, in many instances, 
the audience or staff hears something other than what the speaker said or 
intended, or gives it a veiT different intcipretation. Persons rooting for dif- 
ferent teams often see the same athletic event quite differently. 

Such differences are not mere partisan distortions, but reflect a funda- 
mental process of the human mind. And it may be even more complicated 



42 



than that: Deborah Tannen s You Just Dont Understand^ argiies strongly that 
the knowledge organization of men and women is quite different— a fact 
that probably has significant, but as yet only implicit, ramifications for cur- 
riculum and the structure of learning in schools. 

''Situated cognition" accepted— but not incorporated into teaching 

Educational researchers have also discovered that people are perv'erse: 
They do not learn out of school how they were typically taught in school. 
Nor do they use the knowledge they learned in school the ways they are 
^'supposed" to. For example, in a naturalistic study of Weight Watchers, one 
psychologist observed the behavior of a man instructed to use of the daily 
allotment of % of a cup of cream cheese in a recipe. Had he learned properly 
as taught, he would have set up the algorithm % x % = V\2, then divided 
numerator and denominator by 6, reducing the fraction to Vi. However, this 
depraved man fonned the entire allotment of cheese into a low, shallow cylinder 
Then, using a knife, drew two intersecting lines along the top of the q'linder, 
dividing it into quarters. Finally, he cut three of the quarters away and returned 
the fourth to the refrigerator, efiiciently and accurately accomplishing the 
task set for him. It seems unlikely that he ever knew he was using Vz cup 
of cheese, or cared to know, or needed to. 

This example is not isolated. It represents what cognitive psychologists 
have come to call '^situated cognition!' We doiVt think, this line of argument 
goes, in formalisms. Our thoughts are conditional on the ccmtext, the situa- 
tion, in which we find ourselves. 

But schools attempt to teach formalisms. As noted in (Chapter 3, in 1987 
I^uren Resnick titled her presidential address to the American Fducation il 
Research .Association, *T>eaming In School and Out," and found liule resemblance 
between the two.** In schools, the emphasis was on individual learning; outside, 
on shared learning and teams. Schools emphasized what she called '*pure 
mentation''— what individuals can do alone and without tools. Most activities 
outside of school use some kind of tool to help thought, even an unintended 
tool as with the knife applied to the cream cheese. 

Schools stress symbol manipulation instead. Outside of schools, the con- 
textual nature of learning is recognized. Inside, there is an emphasis on symbol 
manipulation as an end in itself Schools tiy to teach general skills that will 
apply in all situations. 

But such skills seldom transfer. Transfer occurs better when a series of 
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situation-specific skills are taught where the situations have similarities. This 
applies not only to K-12 schooling, but beyond. For example, studies have 
found that expert radiologists do not use the mental processes they were 
taught to interpret X~rays, and that formal training in electronics and theories 
of trouble-shooting provides little knowledge and fewer skills than in actually 
performing trouble-shooting. 

Gardner admonishes: We teach to only two 'Intelligences" 

No book about cognitive psychology has caught the fancy of educators 
as much as Howard (Gardner s Frames of Mind, a tome somewhere between 
a text intended for other psychologists and a book for lay audiences (and, 
as discussed earlier, the inspiration for the Key School). In this book, Gardner 
postulates that there is not one intelligence, as might be inferred from the 
single number derived frcmi IQ tests, but seven. Gardner establishes criteria 
for deciding what an '^intelligence" is, then describes seven: linguistic, logico- 
mathematical, musical, spatial, bodily-kinesthetic, inter-personal, and intra- 
personal. He chides schools for concentrating on only the fn*st two, and con- 
siders that civilization ignores or slights the other five at its peril. Given 
the complex, multidisciplinar\' problems facing the world, he says, we need 
creative people who have novel approaches to solving those problems. 

''Learning styles" further suggest many dimensions 

At the periphen' of the work in cognitive psycholog)' are the purveyors 
of ^'learning styles." Although, the authors of various tomes on learning styles 
have yet to really establish that they count for much variance in peoples 
behavior— or that they even exist in some instances — the notion of leaniing 
styles does suggest that there is a greater \'ariety to mental processing than 
generally assumed in schools. A "one-sizc-fits-all" curriculum or instructional 
program cannot meet the needs of all children. 

Education Strategies Should Reflect Learning Research 

The problem for learners in the educational system is that learning in school 
does not reflect what we now know al)out learning. F;irlier, we cited Deborah 
Meier on the social nature of learning outside of schools and on the impor- 
tance ol' talk in learning. Meier goes on to say: 
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This kind of exchange is never allowed in school, nor modeled 
there— not between children nor between adults. Monthly faculty 
meetings are no better imitations of true discussion than the average 
so-called classroom discussion.^ 

All of the philosophers mentioned and most psychologists in this country 
have concentrated on the knowledge of individuals as if knowledge and in- 
dividuals were independent entities. But learning is not only situated in a 
phvsical environment, it occurs in some kind of social context and, it turns 
out, learning is more powerful and effective in groups. Until recently, this 
most powerful fomi of learning, when it ocaiiTed in school, was called "cheating!' 

Research and common sense support group learning 

The eff icac)' of group learning is driven home by an experiment examining 
achievement differences among ethnic groups. After the experimenters had 
factored out all possible variables, they still found that Asian students were 
scoring higher than students from other ethnic groups, Talking to the students 
in a search for new variables to explain the difference, the experimenters 
discovered that Asian students often studied in groups. In addition, immediately 
after the examination, Asian students convened to talk about it. Then after 
the results came back, they g-athered again, pointing out to students who 
had scored low where they had gone wrong. Blacks, whites, and Hispanics 
almost always studied alone The)' did not convene post-exam meetings to 
go over the material, 

In another, more homely example, a speaker once asked several people 
at a meeting to individually list the National Education Goals, Despite the 
fact that this was a gathering of eminent educators, no (me could do it akme. 
But when the question was thrown open to the entire audience, the list quickly 
emerged: No one knew it all, but all knew some of it. 

Our folk wisdom codifies the power of group learning ("Two heads are 
belter than one'), and delimits its effectiveness in a poorly structured situation 
CToo many cooks spoil the broth"). But historically, we have not only not 
used group learning, wc have punished children who tried. 

Change of Pace Needed 

One would think that teaching, the ])rofessi()n of learners, would transpire 
in a slow, reffective maimer. Surely, tlie way in which people learn, the wiiys 



in which \\v might to assess that iearning, and the desire for thoughtful, 
well-reasoned classroom statements, all require a deliberate pace. 

One would think, but one would be wrong. All signs point to an increasing- 
ly frantic pace of instniction in a futile effort by teachers to cover a curriculum 
that has been called "o\'erstuffed and undernourished." 

People obsening elementar)' teachers report them working long hours 
and doing 17 things at once, no one thing lasting veiy long. The dicta of 
the school demand that. Teachers often bring student work to after-hours 
meetings, hoping the hitellectual demands of the meeting will not prohibit 
them from grading it (students papers are inx-ariably nniltiple-choice, fill-in- 
thc blank, or matching words). And teachers ha\e e\en been seen grading 
homework while waiting in line for concerts ana other events to begin. 
As one other obsener of elementan* teachers reported: 

I'he most outstanding adjustment displayed by all teachers was 
the ability to perform several tasks at the same time. This ability to 
j)erform a number of simultaneous tasks was an etTective way to 
maintain dassnxmi order and to facilitate mpid movement from one 
activity to another h was a necessity due to the rapid changes in 
activity and the almost constant interactions'' 

hi view ()f the discourse about the nature of learning and of quality, 
one wonders what this ''necessity'' inflicts on learning, While there is much 
talk about "reflective practitioners,'' there is much research showing that if 
teachers increase their "wait time," the time from one question to another, 
to three seconds, rather than the typical eight-tenths of a second, the quality 
of answers increases.' Three seconds hardly permits a reflective approach 
to learning, nor does it induce such a habit of mind in students, it does, 
howe\er, represent the pace of events in today's classrooms. 

A study of middle school science classes obsened that teachers who had 
iimisually strong backgrounds in the subject found them making quick-paced 
lectures on topics that the students surely found incomprehensible. Transcripts 
of t^ipcs showed jumps and tunis in dialogue that were unconnected. In laborator)' 
situations: 

Kifty-five percent of the labs recjuired students to develop their 
own answers to a pr()l)lem while proiiding step-by-step instnictions 
about how to do so. . Txiboraton assignments were often poorly 
designed, poorly orgiuii/ed, incoherently written, and were not always 
exj)licitly linked to topic conteiU. StudeiUs rarely were given any 
rationale for completing the labs." 
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And we should note that in the 45 percent of the labs that did not require 
students to de\'elop answers, the teacher simply provided them. 

The authoi-s of this study did not end up saying* "Boy, are these lousy 
teachers." they said, '*Boy, is this a lousy system." 

Researchers concluded: 

II is hard to be optimistic about significant changes occurring in the 
tasks students are expected to complete. Current tasks function within an 
educational system that gives one teacher responsibility for 150 students a 
day and requires the superficial coverage of xast amounts of matenal . . .Changing 
the schoolwork that students complete is tantamount to changing the accepted 
definition of school itself? 

And yet, given what we have said about the nature of learning and of 
quality, such a definition change is required if, indeed, our educational goal 
is to optimize the system. Other researchers have observed that many students 
in science separate tlieir personal knowledge of the world from what they 
learn in science class. Science is seen as not pertaining to their lives. 

In studying school systems outside of this county, Richard McAdams for 
his 1993 work, Lessons from Abroad, interviewed a number of Fulbright scholars 
teaching here. Among the things these teachers reported to him was that 
students in this country' have little idea of knowledge as something cumula- 
ti\e. From the above it is not hard to see why. 

A system to promote reflection, in both teachers and students, would 
surely be one where teachei's had more planning periods and could — and 
would— collaborate in planning. It would be one where, in much of the cur- 
riculum, the dictum "less is more" pre\*ails. That is, students would likely 
become more thoughtful if they were able to gi\ e sustained attention to fewer 
topics rather than flitting from one to another Schools must overcome the 
tyranny of scope and sequence. But it is hard to see how that will happen 
when it "is tiintamount to changing the accepted definition of school itself* 

Some have called for the abolition of the "Carnegie Unit'* and other 
arbitrarv' units that have existed for decades. In recent years, Ted Sizer has 
perhaps been the most vocal and eloquent critic of the time-bound classroom. 
Still, the Carnegie Unit dominates the organization of time in this country. 
We need to change that. It's about time. . .and learning. 
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CHAPTER FIVE 



THE, 

QUESTION Of ■ 
STANDARDS . 
FOR , 
LEARNERS- 



There has been much talk about standards of late. 
"High but attainable standards ' and "world class 
standards" are two oft-repeated phrases. The \'ieu seems 
to be that American students are not held to the high 
standards of other nations, nor to standards suffi- 
ciently high to maintain our international competi- 
tiveness in the next centuiy. "America is the only country 
in the developed world without national standards," 
goes a common refrain. 

Fairfax County, Virginia, Schools Superintendent Robert Spillane caught 
the Zeitgeist well in an Education Week essay. Our lack of standards: 
is educations dirty little secret. . .what most of the public has now 
learned, and many have called their representatives in Congress about, 
is that the abilities of [the] frontline work force in many competitor 
countries are substantially higher than they are in the United States, 
that these countries are educating everj-body to higher levels than 
we are, and that one of the main differences between us and them 
is standards: They have them and we dont."' 

But, here again, we must look at the facts. Not all countries have national 
standards (and many have only national cojitetU), and the American worker 
is unchallenged in productivity. While the Hudson Institute alleged that pro- 
ductivity had "declined substantially since 1965," it had not. Only the rate 
of productivity had slowed. (See Figure 5-A.) Furthermore, the United States 
has lost more than 3 million jobs since a 1979 peak (even though factory 
output has climbed sharply) because of a rapid growth in productivity. (See 
Figure 5-B.) 

Yet the views on each of standards and an inferior workforce are widely 
held. In years gone by, the connnon response to a statement about standards 
would have been, "So what?" For many years, the phrase "only in America" 
coimoted situations and e\'ents that could only happen in the United States, 
and was a source of pride. Now, for many, it is a source of anxiety. 



Why People Want Standards 



The pressures for natitmal standards come from a variety of sources. The 
fear of failure in the ompetititm for the global marketplace is only one. 
Others come to mind readily: 
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FIGURE 5-A 

Productivity Improvement on the Decline 



While the Hudson Institute alleged that productivity has "declined substan- 
tially since 1965," die graph actually shows that it is the rate of productivity 
improvement^ that has been slowing. We are getting more productive more 
slowly than in the past. 
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FIGURE 5-B 
Whaf s Slowing Job Growth? 

While economic recessions and expansions have affected employment 
and production, the long-term trend toward smaller payrolls is likely to 
continue as efficiency improves. Chart shows manufecturing employment 
and productivity, indexed so January 1987 equals 100. 
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• Standards give people something to shoot at, something to measure pro- 
gress by. 

• We don t know where we're going in education and standards will help 
show the way. Schooling has lost its rigor and standards will restore it. 

• High standards will help us attain the kinds of workers we need in our 
complex, technologically sophisticated society. 

They are prone to make comparisons 

Americans are also a norm-driven people. want to know who s number 
one and where we stack up against the best. If we re not number one, we 
want to know why not, and what we can do about it. People continue to 
rank states according to SAT averages even though such comparisons are 
meaningless. (In 199:i for example, the percentage of high school seniors 
taking the SAT varied from 4 percent in Utah to 88 percent in Connecticut.) 
Our rank in international comparisons is the source of much wailing and 
gnashing of teeth— even though, as pointed out in chapter 2, the actual 
scores of American students are veiy close to the international averages 
in math and science, and veiy close to the top in reading. 

Ever since the National Assessment of Educational Progress (NAEP) began 
releasing state-by-state comparisons and. in general, became more visible, 
pressure has mounted for a true national assessment. NAEP was not designed 
to reflect what is taught in school, and its scales and levels cannot be given 
the kinds of interpretations that NAEP officials and U.S. Department of 
Education all too often do. People want a nice, clean number that permits 
easy comparisons. 

increased mobility, diversity cause problems 

Finally, some obser\'ers point to the fact that 20 percent of American 
students change schools each year and the research showing that this poses 
probleins for students and teachers alike. The problems would go away, 
they contend, if the same material were being tiiught in each classroom 
around the nation. A connnon set of standards would give students some- 
thing to shoot at and at the same time help bring together our culturally 
fractious nation. 
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Reasons for Not Having Standards 



Against this set of arguments for national standards are at least equally 
persuasive as arguments against them. 

People iearn differently 

The multiple intelligences theory noted earlier would seem to call for 
individualized instruction: Different people will have differing development 
of the different intelligences and different patterns among them. To maximize 
learning, instruction needs to be tailored to play to these differences. The 
constructivist theories of cognition lead to a similar position: If everyone's 
cognitive structures are to some extent unique, uniform standards will not 
meet some students needs. 

There Is no one best solution 

Standards could also remove professional decision making from teachers 
and bring a dull uniformity to the classroom. Elliot Eisner has argued against 
national standards on the grounds that there are "a number of educationally 
defensible versions of mathematics education, social studies education, science 
education, arts education, or language arts education .... Education is about 
learning to deal with uncertainty and ambiguity It is about learning to 
savor the quality of the journey It is about inquin' and deliberation. It 
is about becoming critically minded and intellectually curious, and it is 
about learning how to frame and pursue your own educational aims*''^ 

Standards testing might have ramifications 

Most proposals for national standards and assessments call for testing 
at grades 4, 8, and 12. Problems are associated with all three levels. Students 
in gi<ide 12 seldom take any test seriously except the SAT or ACT, tests 
with obvious if over-estimated consequences. It is not clear what the grade 
12 assessment attached to standards would do for individuals. For grades 
4 and 8, such assessment contains a new and dangerous element: We have 
never had "high stakes tests ' at these ages. Do we want 9-year-old children 
to have to cope with such? What will happen to fourth graders who aren't 
''up to standard?" Retention in grade? The whole body of research on reten- 
tion speaks with a single voice: It doesn t work. Summer school? Can we 
command such and even, if so, who will pay for it? 
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The tests are of questionable sophistication. Of course, the kinds of tests 
being proposed for the assessment of national standards are still immature 
in terms of the technology of testing. We have had multiple-choice tests in 
their present form for 75 years. Only in the last five or six years has attention 
been given to more complex testing. In Vermont, the state with the most 
experience to date with assessments using portfolios, the assessments have 
not yet attained a great deal of reliability. In this litigious nation, one can 
only imagine the flood of lawsuits that will occur if assessments are used 
to make life-altering decisions. 

Standards won't lead to needed improvement 

Perhaps the most damning aspect of national standards, though, is their 
essential irrelexance. The Second and Third "Bracey Report on the Condition 
of Public Education" showed cleariy that schools that will use the standards 
don*t need them. Schools that need help— in the form of money, equipment, 
textbooks, and even working plumbing— won't use the standards and will 
only be told again that they are not measuring up. Using a different line 
of argumentation, Larry Cuban reached the same conclusion: National stan- 
dards will bypass the 40 percent of schools that most need improvement.' 

Process for Setting Standards Unclear 

The debate over the pros and cons of standards is likely to continue for 
some time. Exactly how such standards are to be established has never been 
specified and this raises questions about the enterprise. At this writing, profes- 
sional organizations are da^eloping standards in the usual curriculum areas 
and through some, yet-to-be-determined process, these will become national 
standards. The standards developed by the National Council of Teachers 
of Mathematics (NCTM) appear to be the model other curriculum areas 
will follow. In many discussions about these standards, no distinction is 
made between content standards and performance standards. 

Coordination with other efforts needed 

Also at this time, there is a New Standards Project co-directed by l^uren 
Resnick at the University of Pittsburgh and Marc Tucker at the National 
Center on Kducation and the Economy in Rochester, N.Y. How this effort 
will fuse with the work of the professional groups has not been addressed. 



Funded from foundation grants, the project's goal is two-fold: 

• To establish high but attainable standards in five curriculum areas; and 

• To develop a *^'()luntar^''' assessment system in grades 4. 8, and 12, 
The assessment system is to include all forms of tests, including multiple 

choice, essay, perforniance, portfolios, and exhibitions. These rarious testing 
forms are to be somehow ''calibrated'' so that scores from, say, a multiple 
choice test used by one state can l)e compared with, say, a performance test 
used by another state. Many feel that this calibration is not technically possible 
and, in fact, in recent months the word seems to have disappeared from 
the New Standards lexicon. 

We can note in passing that the New Standards Project has been criticized 
for another shortcoming, although not one of its own making. Although 
Resnick is a cognitive psychologist, the New Standards Project is organized 
around a very traditional core ciuriculum and it is not clear how much psycholog)' 
will enter tlie development process. This traditional organizati(m also is taking 
place at a time when many people are calling for instruction organized around 
themes or concepts that cut across traditional topics (a strateg)- compatible 
with cognitive psycholog)' theories). Most current textbooks and work materials 
have attracted criticism because tliey present isolated facts unconnected to 
other facts in the same book or the facts of other curriculum areas. By staying 
with the traditional topical approach to curriculum, the New Standards Project 
could reinforce this isolation. 

History of minimum competency testing ought to be considered 

While various groups are in the process of establishing world class stan- 
dards, we should not forget that in tlie 197()s, 35 states established some 
kind of minimum competency testing programs. These programs could well 
have been characterized as creating ''low but attainable standards." Yet still 
some students did not meet the standards e\'en after taking tlie tests three, 
four, or a half dozen times. 

How, then, such students will clear the new ''high but attainable" hurdles 
is not clear, llie answers I liavc received when I have posed tliis question 
have been notable for their naivete about schools, the students in them, 
and tlie relationship between changes in policy and changes in practice. 
In any case, it is important to note that setting stwulwds does not necessarily 
increase performance. 

hi any case, where to set the standards is a critically important issue. 
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and difficult to resolve. The 1993 NCES report "Education in States and 
Nations"* further analyzes the data from the Second International Assessment 
of Educational Progress. One such analysis revealed enormous variation around 
the average scores for states and countries. As one goes from Mississippi 
with the lowest average score to Taiwan with the highest, one traverses a 
distance of 39 NAEP scale points. But as one goes from the 1st to the 99th 
percentile of Taiwan students, one sees a range of about 150 points. This 
raises doubts about making generalizations regarding any nation's schools 
based on average scoi^^. More immediately, it raises the question of where 
a cut score could be placed that people would call meaningful, which would 
not also flunk a large percentage of students. What would be done to handle 
the ensuing chaos has not been explained. 

Practitioners need to be involved 

The NCTM standards have been well-received in most quarters, although 
those quarters do not yet include many classroom teachers. For many of 
them, the standards remain invisible. In an arena such as this one, teachers' 
voices are rarely heard, and we must question: Haw far through the classroom 
door can a set of standards get if teachers feel no ovmership of them? 

Standards shouldn't put youngsters at risk 

In the process of setting standards, care should be taken to avoid the 
standard-setting problems at the low end of the age scale. People genuinely 
differ on whether kindei^rtens should be more developmental or more 
academic in nature. In some places, kindergartens have become "mini-first 
grades," a development which puts the younger children in the class at a 
disadvantage and sometimes at risk. In such settings, one hears discussions 
about whether a child is "ready" for kindei^rten (or for first grade at 
the end of kindergarten). 

After listening to these arguments for a number of years while conducting 
research in kindergartens, Lorrie Shepard of the University of Colorado 
concluded that the concept of readiness should be abandoned.^ She feels 
it perverts the moral tone about what education should strive for: It implies 
that "readiness" is a condition that dwells within a child when, in fact, 
it is a complex constellation of aflfairs involving the school, the teachers, 
the parents, and a host of others in a micro-system. The common concept 



of readiness also implies that the child exists for the convenience of the 

school, not vice versa. 

It is worth noting, that when American educators and psychologists and, 

sometimes, reformers get into standard-setting activities or deal with norms, 

they are prone to try and speed things up. When American psychologists 

concluded that Piaget*s stages were not methodological artifacts, their first 

interest was in how to get kids through them fester. 

During most of our history, there have been occasional counters to this 

national characteristic. In 1782, Thomas Jefferson warned: 

There is a certain period of life say from 8 to 15 or 16 years 
of age, when the mind like the body is not yet firm enough for laborious 
and close operations. If applied to such, it falls an early victim of 
premature exertion; exhibiting, indeed, at first, in these young and 
tender subjects, the flattering appearance of their being men while 
they are yet children, but ending in reducing them to be children 
when they should be men.^ 

More recently, Paul Diederich wrote this cautionary tale in a 1959 critique 
of J.B, Conant. Its message is both important and overlooked in the current 
climate: 

As we advocate a *get tough* policy with these superior students, 
we should realize that we are advocating a daily schedule for growing 
uoys and girls, at the most social and fun-loving period of their lives, 
that is a lot tougher than any adult puts in — except a few harassed 
executives with ulcers. Whenever we teachers go to educational conven- 
tions, do we regularly go to seven or eight meetings per day, sitting 
on hard chairs in cramped quarters the whole time, and then return 
to our hotel room to put in three or four more hours boning up 
on what the speakers wanted us to know, so that we could prove that 
we understood it and remembered it when they quizzed us about 
it the next day?. . .You may say, This is sheer exaggeration. Surely 
going to high school is much nicer than this!' No it is not, and I 
know whereof I speak. I have just been sitting in classes day after 
day. ... I solemnly declare that at the end of each day visiting classes- 
even though I am treated as a VIP, not as a guilty student— my funda- 
ment is sore, my legs are cramped, my eyes are tired» my brain is 
reeling, and I would rather do anything on earth than study for three 
or four more hours what these students are supposed to study. It is 
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not that the teaching is bad; there is simply too much sitting down, 
listening to talk, talk, talk. We say that these students ought to learn 
to ''work hardr and they would not mind that in the least; it is the 
sitting down and listening all day in a space half the size of a grave 
that gets them down ... 7 

The teachers come out of it as scarred and tired as the students. 
The art of teaching is so delicate and difficult that I would be willing 
to bet that we shall wind up with the fully documented conclusion 
that no one can do it effectively for more than two hours a day. All 
of this dreary, ineffectual round is based on the assumption that learn- 
ing proceeds best when administered in doses of five periods a week 
plus homework for all academic subjects. This assumption is unsup- 
ported by a shred of ev idence m all experimental litemture, contrary 
to common sense, and contraiy to the practice of almost all colleges. 
Dr. Conant does not say one word to justify it. 

Standards should reflect professional levels 

Ultimately, as with athletic and performing arts judgments, we must 
tiike our standards from the professional level. It is telling that when we 
watch, say, a basketball game, we have implicitly, and perhaps sometimes 
explicitly, in our heads a knowledge of the professional level of play, and 
perhaps even of the best current performers within the sport. All-star games 
allow us to observe the best-of-the-best together. 

It is doubtful, however, that a teacher ever reads a student s story thinking 
of its images in comparison with those of, say, John Updike, or reviews 
a student exposition comparing its prose to that of John McPhee (unless 
he or she suspects plagiarism). But why not? 

One we leave the field of literature, the distance of school students 
from exemplars and standard setters becomes even more obvious. Authors, 
at least, publish works in popular periodicals. Scientists and mathema- 
ticians generally do not. It is liule wonder, then, that Magdalene Uunpert 
finds that the way children approach mathematics in fifth grade bears ab- 
solutely no resemblance to mathematicians doing mathematics or discoursing 
about it.^ (In addition to conducting research at Michigan State University 
and, starting in 1993, the University of Michigan, Iximpcrt teaches mathe- 
matics in elementaiy schools, giving her a perspective seldom found among 
researchers.) 
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It is not simply the abstruseness of what adult mathematicians do, but 
the communication about the concepts that is \'astly different. When Lampert 
attempts to teach students to talk about mathematics in ways used by mathe- 
maticians, interesting things happen. Conversations sometimes resemble the 
genuine discussions that Meier, in Chapter 3 declared were so lacking in 
schools. Children come to see mathematics not as a set of fixed rules that 
come from '*out there," but as a hunian construction, under constant revision. 
(Some of the children, after four years of traditional mathematics, do not 
initially gravitate to Lampert's approach. Most of the resisters want her to 
take the traditional teacher role of information giver, while a few^ want to 
vote on what's right or follow idiosyncratic lines of thought because it's 
"their way.") 

Standards should reflect ''customers'" needs 

There is an approach to devising standards little tried in education, 
but quite common in industr)^ and commensurate with a systems approach: 
The customer decides what the appropriate standards are with their pur- 
chases. Just who the "customer" is in education, of course, is difficult to say. 

There are two models of schooling that flow from a customer determina- 
tion of quality. The first considers the parents as the tme customers, the 
second thinks of customers in terms of the next level of consumer. 

The first model argues for a free market approach to schooling, with 
parents free to choose whatever schools they wish. Good schools are expected 
to thrive and expand. Poor schools will be challenged to become good schools 
or go out of business. This model is discussed in the next chapter. 

The second model of schooling holds that the next consumer is the 
customer of the earlier consumer, albeit not a customer free to buy or not 
buy until the "product"— the student— reaches college-age. That is, the next 
consumers of college graduates are graduate schools, business and industry 
and, to a lesser extent, the military. For high schools, the next consumers 
are colleges, business and industry, and the military. 

One caution on "local" customers. Although establishing standards in 
terms of customer satisfaction raises many questions and problems, it seems 
the most appropriate approach to the question of standards in schools. 
It is an approach that lends itself more to local standard setting than to 
national standards, however, because local conditions will be the most impor- 
tant considerations. Constmed too simplistically, it assumes that the standards 
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at the next level are the appropriate ones, and, without external oversight 
by other concerned parties, they may well not be. 

Businessmen, for example, have been known to self-servingly ask schools 
to teach and set standards for some skills that would more appropriately 
be left to the businesses to develop and apply as part of on-the-job training. 
Indeed, the SCANS and Sandia reports indicate that American employers 
often provide very' little training for their employees (50 hours for new auto 
workers at U.S. manufacturers, 350 hours for new auto workers at Japanese 
manufacturers in Japan, 300 for new workers at Japanese manufacturers in 
the United States). These studies also found that business and industry in 
this countiy spend a disproportional amount of training mone)' on skilh^d 
and college-educated employees, while those in other countries develop skills 
at all levels. 

Consumer approach supports continuity. Notwithstanding the problems 
in resolving the perhaps competing characterizations of quality by differing 
consumers, the notion of next-level-of-consumer has great appeal. It allows 
for a continuity, or at least an articulation, among institutions that now inhabit 
separate, non-communicating worlds. 

Here's one personal example: Following a suggestion from Grant Wiggins 
at the Center for Learning, Assessment and School Stmcture, this author 
recommended to a group of teachers that they take a set of senior essays 
over to the local university along with some money, and that they use the 
money to pay professors to grade the papers. It was further suggested that 
they bring some graded freshman papers back to show their students. 

The idea startled them. Currently, the prime use of the (\'agueiy perceived) 
university standards, for teachers, seems to be to iiy to moti\ate students 
with comments such as, "It won't be this easy in college!" And it isn't. Many 
students experience a one-somester crash or more before they abandon their 
previous levels of effort and ratchet up to what the collegiate level demands. 
There is no reason that this disparity should exist. Surely, we can eliminate 
or reduce the discontinuity between high school and college work without 
producing the Japanese system where students work extra hard in an attempt 
to get into colleges (especially into the few colleges considered prestigious), 
but then burn out and spend many years treating their campus life as essen- 
tially a long nap. 

One Canadian district, C^arletoii, has taken the next-consumer-based- 
standards approach seriously. Students are given booklets containing the 



rubrics that are used to score papers. They also are given 10 exemplary papers 
and explanations about why those papers merited the grade they received. 

This contrasts sharply with the approach to education in much of the 
United States where, according to Meier, "schooling becomes a vast game 
in which teachers try to trick students into revealing their ignorance while 
students try to trick teachers into thinking they are not ignorant." If students 
in high school could see exemplars of good college work and understand 
the rationale behind the various grades, it would make education much more 
meaningful to all concerned. 

A system of standards, open and known to all coupled with instruction 
that reflects how people learn and what they should learn, would cure a 
lot of the pathology seen in the last quote. Currently, we operate a system 
that all too often is analogous to placing a hood over people's heads, leading 
them onto a basketball court, telling them to shoot baskets, then grading 
them in "basketball.'* the students do not know what to expect and the feedback 
they get provides little or no information on how they can improve. 

A system of standards, with accompanying benchmarks, would do a lot 
to alter lY '^ Such a system would also align itself well with psychological 
considerauuii. .)n how people learn. 
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CHAFER SIX 



SYSTEMS 
AND THE 
ASSESSMENT 
OF LEARNERS 



At the end of the last chapter, the word ''benchmark" 
is used. This is a term common in industry or 
athletics, but seldom seen in education. A system of 
education, though, needs benchmarks in order to assess 
progress. More importantly, it needs benchmarks to 
assure quality. "Quality ' in schools is seldom discussed 
openly. In schools, it has more of an "Fll-know-it- 
when-I-see-it" character. (And to some extent, this 
fuzzy aspect of quality is unavoidable.) 

l^uren Resnick, in delineating the characteristics of higher order thinking, 
noted that it, too, ras difficult to specify in the abstract and in advance. 
If one holds that such thinking is a desirable outcome of schooling, then 
some vagueness is necessarily introduced into the system. Indeed, in his writing 
about the concept of synthesis, Benjamin Bloom approaches a point of saying 
that it cannot be known in advance. 



Current Approaches Obscure Quality 

Whatever the nature of quality, there is general agreement that there could 
and should be more of it in schools (see, for example, William Glasser'). 
A number of factors, however, keep quality from view. The current assessment 
system, for example, does not permit us to see it. Multiple choice questions, 
which dominate this system, are poor lenses for actually, directly viewing 
quality performance. Scores reported in terms of percentile ranks, grade 
equivalents, and the truly incomprehensible Normal C'ui-ve Equi\^lents in- 
dicate only if a student's performance is as good as, better than, or worse 
than some ^'norm'' — or the others who took the test, or others of the same 
age. They do not, cannot, tell us if a performance is good, bad, or indifferent. 

Quality also is obscured because we are not treating learners in ways 
that optimize learning, as discussed in chapters 3 and 4. One of the promises 
inherent in the idea of "authentic * tasks and tests is that they will unleash 
students* pent-up desires to actually do well. Whether that is true or not 
depends on a host of factors, not all of them under the control of the school. 
But it is clear that, for learning to "break out all over ' as Philip Schlechty 
of the Center for l.eadership and School Reform once lightheartedly put 
it,^ the tasks to be learned, the methods of instruction, and the assessment 
of the outcomes all need to be changed. 
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Why Not Take Our Lead from Athletes? 



Assessment in education should resemble the assessment of the performing 
arts and athletics. In particular, the scoring and reporting system of cross-country 
running seems appropriate to a system where everyone counts and continuous im- 
provement is the goal: 

In cross-country, each team has seven runners. The scores of the first 
five count in a team's total. Everyone runs the same distance, but it is 
hardly expected that they will all finish at the same time. While the scores 
of the sixth- and seventh-place runners are not counted in the team's total, 
if team A's sixth- and seventh-place finishers finish ahead of team B's fifth- 
place runner, they diminish team B's score. Thus, everyone can be important 
to the outcome of the match. In addition, times are kept for a season 
and in some places for an entire career of four years. The goal for each 
individual is to get better over time. Progress over previous performances 
and attaining a new '^personal best" is emphasized. 



The current system of tests and measures, ability tests, achievement tests, 
college entrance examinations, and the National Assessment of Educational 
Progress (NAEP) are all, individually and collectively, inadequate to measure 
the quality of the system or the quality of individual performances, or to 
benchmark progress. 



Achievement tests, with the possible exception of the rarely used kns^a Test 
of Educational Development and the more popular Degrees of Reading Power, 
do not assess complex intellectual behavior, not to mention other valued 
qualities. 

A 1992 study commissioned by the National Science Foundation examined, 
iteni-l)y-item, for grades 4 through 12, commercial achievement tests in 
mathematics and science and tests that accompany textbook series. In 
mathematics, for both types of tests, only 3 percent of the items assessed 
liigh quality content; only 5 percent evoked higher order thinking.^ 

Another analysis by Thomas Rombei'g at the University of Wisconsin 
found that mathematics achievement tests do not map well into the content 
areas specified in the highly regarded standards published by the National 
CiOuncil of Teachers of Mathematics (NCTM).^ The tests overemphasized a 
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few areas, such as computation, and ignored many others almost entirely. 
(New editions of some recently revised tests now claim to reflect the NCTM 
Standards.) 

Despite contentions that the United States has a de facto national cur- 
riculum because textbooks are similar, in fact, local variation is the rule. Thus, 
a set of achievement tests cannot be linked specifically to any particular cur- 
riculum. If it were, the tests publishers could only sell to districts and states 
using that curriculum. 

Naturally, publishers want the largest possible distribution for their tests. 
So test developers must use only questions that sample the most generic 
skills and knowledge. Such tests cannot say much about the educational out- 
comes of a specific curriculum (although, if the stakes become high enough, 
such tests will become the cuiriculum). 

Why all the secrec)'? The secrecy surrounding tests perverts the whole 
educational system. If tests are supposed to measure what we think is impor- 
tant, how can we possibly justify not telling people what is on them? 

Bell curve doesn't support education's goals 

In addition to these content problems, the most common types of tests 
also have undesirable statistical qualities. 

Because this country has historically used tests primarily to separate sheep 
from goats, not to improve learning, the items selected are largely those that 
50 percent of the students fail. Such items maximally disperse students along 
a normal, bell-shaped curve. 

The appropriate outcome of education is not a normal curve, of course, 
but what statisticians call a J-cune. In a J-curve, only a few people score 
low and most score high. As Bloom, Madaus, and Hastings put it: 

There is nothing sacred about the normal curve. It is the distribu- 
tion most appropriate to chance and random activity. Education is 
a purposeful acti\'ity, and we seek to ha\'e the students learn what 
we teach. If we are effective in our instruction, the distribution of 
achievement should be ver>' different from the normal curve. In fact, 
we may even insist that our education efforts have been unsuccessful 
to the extent that the distribution of achievement approximates the 
normal distribution.* 
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In addition to these statistical problems, there are severe questions about 
whether or not the multiple-choice format of tests can ever measure the out- 
comes educatoi-s truly consider important. 

Ability tests just cloud the picture 

Aliility tests often are alleged to measure "potential." They differ from 
achievement tests only in that, while the skills and knowledge of achievement 
tests are mostly taught in schools, it is not clear where the skills tested by 
ability tests are learned. 

For example, one item on a popular ability test presents the student with 

the analogy, "Canada:United States as :Kenya." To answer 

this item correctly, one must first understand the meaning (or the game) 
of the analogy, then apply highly specific geographical knowledge. The answer 
is Ethiopia, although a plausible case could be made for Uganda or Tanzania. 
Ethiopia "sits on top of" Kenya as Canada "sits on top of the United States. 
The argument for Uganda or Tanzania would be that, as Canada is an English- 
speaking neighbor of the United States, so are Tanzania and Uganda English- 
speaking neighbors of Kenya. 

The Standards of Testing promulg-ated jointly in 1985 by the American 
Educational Research Association, the National Council on Measurement 
in Education, and the American Psychological Association state that there 
is little, if any, meaningful difference in the constructs of ability and achieve- 
ment as reflected in paper-and-pencil tests. A report on ability testing from 
the National Academy of Sciences reached a similar conclusion, h appears 
that the use of "ability" tests, whether or not in conjunction with "achievement" 
tests, would obscure any picture about educational standards or outcomes, 
not clarify 

College admissions exams also fail the relevancy test 

Neither of the two popular college entrance examinations, the SAT and 
the ACT, was intended to measure the outcomes of schooling. Indeed, for 
many years, the College Board and the Educational Testing Service (sponsors 
and developers, respectively, of the SAT) argued that the SAE was curriculum- 
free and impervious to coaching. 

Of course, these claims now are recognized as naive. It would also be 
naive to think that a test such as the SAT— consisting only of 85 vocabulary, 



antonym, analog)', and reading comprehension questions, and 60 arithmetic 
and simple algebraic and geometric concepts questions— could fully measure 
the results of 12 or 13 years of education. 

In recent years, the College Board has, apparently for political and marketing 
reasons, argued that the SAT can measure improvements in education. But 
this position is not tenable. The "new'' SAT, implemented in 1994, may contain 
more school-rele\ant questions, but suffers the same problems of breadth 
and depth. Initial impressions of the new SAT have not described it as much 
different from the old SAT 

The NAEP is flawed as well 

Similarly, the KAF.? (National Assessment of Educational Progress) was 
never constmcted to reflect a particular curriculum. In its inception, it was 
a creative approach to testing that involved asking students some questions 
that all students might be expected to know and some questions that very 
few students might l)e expected to know. It also used a \'ariety of item for- 
mats. This is in contrast to the typical achievement test that comes only with 
multiple-choice questions chosen so that about 50 percent of students fail 
each question. 

1 he NAEP has undergone an unfortunate transformation in recent years 
through twin attempts to provide criterion-referenced interpretations of test 
scores and to establish scales and stiindards using the existing item bank. 

In regards to criterion-referenced interpretations, NAEP officials often 
make statements like the following: 

More than half of the nations 17-year-olds appear to be inade- 
quately })repared either to perform competently jobs that require 
technical skills or to benefit substantially from specialized on-the-job 
training. The thinking skills and science knowledge possessed by these 
high school students also seem to be inadecjuate for informed par- 
ticipation in the nations civic affairs.' 

Naturally, such statements are de\'( )ured by the press, but various education 
writers ha\'e absorbed them uncritically as well. Thus we find Lawrence Sted- 
man of the Stale Universiiv of New York writing that, '*NAEP data show- 
that onlv a minoritv of students reach the le\els considered necessar) for 
higher education, business, and government."^ And Albert Shankcr, president 
of the American Federation of Teachers, claiming that the 'Tmdings of the 



NAEP indicate that few students are ready to do real college-level work or 
to handle a good job."^ 

Robert Forsyth of the University of Iowa has argued that such criterion- 
referenced interpretations are not permissible, although he does not put it 
quite so bluntly/^ After a detailed examination of how the scales are con- 
structed and a discussion of their statistical properties, Forsyth asks, "Do 
the NAEP proficiency scales yield valid criterion-referenced interpretations?. . . 
Given the observations presented above, 1 would answer, without reservation, 

As for setting standards on the NAEP, the NAEP item bank was never 
constructed for such purposes and is inadequate to it. Nevertheless, the Na- 
tional Assessment Governing Board (NAGB) attempted it. In addition, NAGii 
hired a team of highly regarded educatoi*s to evaluate the standard-setting 
process. The team concluded that it did not work.^^ NAGB's response to this 
bad nevvs was to summarily dismiss the evaluation team, thus politicizing 
the NAEP 

A 1993 report from the US. General Accounting Office (GAO) determined 
that the standard-setting procedure, while improved between 1990 and 1992, 
remained flawed to an extent that rendered invalid the kinds of judgments 
NAGB wished to make: 

We conclude that while A(.Ts 1992 procedures have addressed 
«ome of the problems that affected the 1990 standard setting, the 
fundamental problem of finding a test score that can validly be inter- 
preted in tenns of NAGB s definitions and descriptions remains unad- 
dressed. If anything, the gap between the level definitions, the achieve- 
ment level descriptions, and actual performance at the NAEP score 
selected for each level is likely to be greater than before. Unless and 
until NAGB can show that its approach is internally consistent and 
produces valid interpretations of the NAEP scores selected to represent 
each level, it should either refrain from reporting in terms of achieve- 
ment levels at all or present the levels scores simply as NACiB's Judgmental 
standards for partial, solid, and superior performance, without further 
interpretiition.''^ 

In general, the GAO concluded that the standards set by NAGB "do not 
necessarily imply that students have achieved the item mastei-y of readiness for 
future life, work, and study specified in NAGB's definitions and descriptions'* 
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Researchers at the National Center for Research on Evaluation, Student 
Standards, and Student Testing (CRESST), a consortium of the University 
of California at Los Angeles, the University of Colorado, and the RAND 
Coi-poration, reached similar conclusions. Students performing at a certain 
NAEP level were found to be able to do some problems they shouldn't be 
able to do, and unable to do some they should. The NAEP mathematics 
assessment, said the CRESST researchers "did not measure some of the attri- 
butes included in the descriptions of the achievement levels and measured 
some other attributes only poorly In sum, then, our analyses do not sup- 
port the validity of the published content descriptions as characterizations 
of what students within specified score ranges can do."^^ 

The problems discerned by the NAEP evaluation team, the GAO, and 
CRESST would, alone, be sufficient to rule out NAEP as an index of quality. 
But, in addition, NAEP also underestimates the levels of achievement of American 
students. 

The National Center for Fair and Open Testing (FairTest) figures that 
American schoolchildren bubble in 100 million answer sheets a year. Some 
think that estimate conservative. Whichever, American kids sit for tests so 
often, they do not take yet another one seriously unless they have some reason 
to do so. The NAEP gives them no reason because it enters and exits their 
lives in a single day, leaving no trace. Neither parents, nor teachers, nor the 
students receive any feedback about the children's performance and what 
it might mean. 

To the students, a test like the NAEP is a yawner. When Cherry Creek, 
Colorado, students participated in a 1991 trial of NAEP state-by-sune com- 
parisons, fully half of the teachers reported that they had trouble keeping 
the children on task. 

Because tests used in international comparisons have no more meaning 
for American students than the NAEP, these comparisons suffer the same 
problem. Such comparisons might be salvageable if all students reacted to 
the tests the same \\ay. But, as discussed in the next few pamgraphs, the 
dearth of motivation in U.S. children may not affect the students in other 
countries. 

Student Motivation Affects Comparisons, Validity 

No one should underestimate the importance of motivation to performance 
on tests in school. One superintendent of a mostly niral district in Virginia 
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concluded that the tests taken as part of the state testing program, while 
used to pass judgment on the district itself, held no interest for his mostly 
noncollege-bound students. In hopes of making the tests more pertinent, 
he recast them as analogous to athletic competitions. As in athletics, the 
goal was to outscore the archrival adjacent county. During the week of testing, 
teachers dressed as cheerleaders and led pep rallies in the auditorium where 
students in the affected grades were cheered on by their teachers and other- 
grade peers. Scores improved 20 to 35 percentile ranks, depending on test 
and grade. 

At one level, the superintendent's actions make sense: Administrators and 
other parties want to ensure that students perform at their best. On the 
other hand, on a standardized achievement test like those found in most 
state progrcims, the scores of those taking the test "for real" are compared 
to those in a national norming sample who receive no special preparation. 
(Indeed, it is actually in the school's interest to perform poorly when the 
test is being normed in order to look better when taking the actual test.) 
In any case, motivation counts— and that motivation for doing well on tests 
varies considerably from situation to situation. 

It is worth noting, as an indicator of the importance placed on tests, 
that the Virginia district's strategy^ came to light in the first place because 
the Virginia Department of Education had had so many instances of "inap- 
propriate administrative procedures*' in the state testing program that it had 
to create a computer program to identify districts with unusual patterns of 
test score changes. 

Motivation no doubt affects the outcomes of international comparisons, 
but how much is not known. The students likely show the same level of 
interest in international exams as they do for the NAEP. In contrast, Archie 
Lapointe, director of the Second International Assessment of Educational 
Progress (IAEP-2), reported a different reaction in Korea. As the selected 
students' names were called, they stood and exited for the testing room to 
loud applause from their peers. Such an honor to be chosen to perform 
for the nation! Truly for these students, the lAEP was the equivalent of an 
educational Olympics. 

The issue of motivation is part of a larger issue in testing that is usually 
given short shrif^t by psN'chometricians, namely face validity. If tests doiVt have 
face validity to those taking them, they will not perform as well as they could. 
One research study f-amd that elementary- school students tmsted tests as 
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indicators of accomplishment (that is, the tests had face \'alidity), but middle 
and high school students had grown suspicious of them.^^ 



A New, "Authentic^' Approach Is Needed 

The characteristics of the various types and formats of current tests make 
it obvious that if we establish the appropriate approach to learning as discussed 
in Chapter 3, the current assessment system would not permit us to see how 
well students are learning. It would make little sense to have children engaged 
in meaningful tasks and collaborative learning using multiple intelligences 
if we then sat them down to bubble in answer sheets for a paper-and-pencil 
examination. We need an entirely new approach to the evaluation of learner 
outcomes. 

As hinted at in the beginning of this chapter, the kinds of assessments 
called for to even approach what W. Edwards Derning called Total Quality 
Management are those that generally go under the not terribly useful but 
popular name, ''authentic assessment." An example will illustrate the difference 
between authentic assessments and the usual tests. 

A typical standardized test question might look like this: 

What is the volume of a cone that has a base of 78 square centi- 
meters and a height of 12 centimeters? 

a. 30 cm^ 

b. 312 cm^ 

c. 936 cm^ 

d. 2808 cm' 

Such a question has no context. Its worst feature is that we have no way 
of knowing why a student chooses any of the alternatives. Did he guess? 
Answer by rote application of an algorithm? Think it through logically to 
the right answer? Think it through logically to the wrong answer (a frequent 
occurrence in younger children)? Or react to some *4ocal condition"? (In 
one New York district, when a test question asked, **What animal is most 
likely to be found on a farm?," most children eschewed the '^right" answer- 
chicken— in favor of "giraffe." A nearby game park with the words "animal 
farm" in its name used a giraffe in its logo.) 

This kind of question, and the instniction that precedes it, leads students 
to meaninglcsslv apply algorithms. The NAEP once confronted students with 
this problem: 1,128 soldiers need to be transported from one base to another. 



Eilch bus holds 36 troops. How many buses are needed? Twenty-nine percent 
of the students gave the answer *'31 Remainder 12r ObserverMiote that when 
students take such context-free tests, they are devoid of affect, save those who 
are visibly anxious. 

A revision of the first question would improve matters: 

A student goes to buy an ice cream cone at the store on a warm 
summer's day The cone has a length of 12 cm and the ice cream 
scoop is a sphere with a diameter of 5 cm. If the ice cream melts 
while in the cone, will all the melted ice cream fit in the cone? Explain 
and support your answer. 

This is largely the same problem as the first, except that it includes the 
calculation of the volume of a sphere as well as a cone. It further requires 
the student to compare the two volumes and to support the answer. The 
problem is set in a meaningiiil, if not realistic, situation. 

An even more authentic assessment, though, is one like the following: 

Background: Manufacturers naturally want to spend as little as possi- 
ble, not only in making the product, but on packing and shipping it 
to stores. They want to minimize the cost of production of their packag- 
ing, and they want to miximize the amount of what is packaged inside. 

Setting: Imagine that your group of three people is one of many 
in the packing department for M&M's candy The manager of the 
shipping department has found that the cheapest material for ship- 
ping conies as a flat piece of rectangular paperboard. She is asking 
each group to help solve this problem: 

What completely closed container, built out ol' the given size of 
paperboard, will hold the largest volume of M&M's for safe shipping? 

1 ) Prove to the company executives that both t^e shape and dimensions 
of your groups container idea maximize Jie volume. You will 
turn in a ronvindng\\r\[{<^n report to the company managers, mak- 
ing your case and supplying all important data and formulas. 
Your group also will be asked to make a three-minute oral report 
at the next staff meeting. Reports will be Judged for accunwy, 
thoroughness, and persm ^veness. 

2) Build a model (or nuiltiple models) out of the paperboard of 
the container shape and size that you think solves the problem. 
The models are not proof* they will illmtrate the claims you will 
ofler in your report.''' 
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Now we have a problem thai respects the students and is worthy of solution. 
It is a real world problem, requiring justification of answers. It also requires 
collaboration, much as in the world of work, and the application of knowledge 
for a most common and important purpose: to persuade others of the rightness 
of the answer. 

The benefits of authentic assessment 

There is no "gotcha" about the test; even'thing about it is public and 
nonarbitrar)'. This assessment measures not what knowledge the student luis, 
but the far more important outcome of what the students can do with that 
knowledge. And students have multiple attempts at using and demonstrating 
their knowledge. The\' just don't give the first answer, nor a single summative 
"answer" that is right or wrong. 

Such a problem would tell a teacher a lot about students' understanding. 
The teacher could assess comprehension through students questions as well 
as through their answers. (See sidebar.) By building a model, students can 
test their solutions for viability. 

Finally, this assessment has a likely outcome of imfnvvirig performance, 
not just measuring it. This kind of test is an assessment adequate to and 
reflective of meaningful education. It also reflects the nature of what the 
learner in the system is like. 

Grant Wiggins, in Assessing Studefit Performance, provides another example 
of authentic assessment and its benefits. He presents a long passage from 
which test questions are derived. The passage analyzes the history of the 
American Revolution, not in terms of a people determined to throw off an 
oppressive regime and establish a democratic nation, but in terms of class 
struggles (a Marxist analysis).'^ 

It would be easy to write the traditional reading comprehension questions 
for such a passage (Who benefited from the plantation society? a) Slaves, 
b) Freemen, c) British Royalists, d) Plantation owners), l)ut that is not what 
Wiggins does. He poses a different task for testees. They must prepare a 
five-minute speech supporting or refuting the proposition that this historical 
analysis is appropriate material to he found in the libran* of an American 
public high school. The speech will be judged on clarity, accuracy; and 
persuasiveness. 

A reader confronted with sudi a task would likely do well on any test 
of reading comprehension: lb defend something well requires intimate 



knowledge of what is being deicnded. A person studying the passage only 
for a reading comprehension test, though, would likely hem and haw and 
stumble around trying to conduct a defense of either side of the proposition. 

The second test, the authentic assessment, allows us again to see how 
a person can use a repertoire of knowledge and skills in a complex perform- 
ance. And as with the previous example, it allows us to see knowledge used 
to convince others that our position is the correct one. 



Tests Should Provoke Questions as well as Answere 

In Assessing Student Performance, Grant Wiggins argues, correctly, that 
assessments should concentrate on the quality of students' questions: 

Too often in assessment, we worry about whether students have 
learned what we taught. This is sensible, of course, but such a view of 
assessn^ent, taken to extremes is incompatible with the 'test' of the liberal 
arts. The arts that would make us free enable us to criticize sanctioned 
ideas, not merely re-tell what was taught. 

It is the astute questioner, not the technically correct answerer, who 
symbolizes the liberal artist. We would do well to recall a point made by 
the philosopher Gadamer who argued that it is the dominant opinion that 
threatens thinking, not ignorance. Ensuring that the student has the capaci- 
ty to keep questions alive in the face of peer pressure, conventional wisdom, 
and the habit of our own convictions is what liberal arts must be about. 

We should think of our task as introducing the student to cycles of 
question-answer-question and not just question-answer— with the aim of 
a course being, in part, to make the student, not the teacher or text, the 
ultimate initiator of the cycle. To unendingly postpone the students' ability 
to ask important questions in the name of mastery' is to jeopardize their 
intellect. Good judgment and aggressive thinking will atrophy if they must 
incessantly be postponed while professors profess.^^ 



People in the field of testing have constuicted The biw of \V^TI\\T(;: 
What You Test Is What You Get. So we had better test important things 
in meaningful ways. Cionsider for a moment Israel Sthetricr's definition of 
education: 

T he formation of habit.s of judgment and the development of 
character, the elevation of standard.s, the facilitation of understanding, 
the development of ta.ste and discrimination, the stimulation of 
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curiosity and wondering, the fostering of style and a sense of beauty, 
the growth of a thirst for new ideas ana visions of the yet unknown?^ 
A moment with this definition makes it abundantly clear that the current 

assessment system not only doesn't measure the educational outcomes w^e 

desire, it stifles them. 
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CHAPTER SEVEN 



CHOICE 
AND 

STANDARDS 



e deal with the concept of choice here not because 
choice necessarily is an essential component of 
the system, but because some believe it represents 
a different approach to the issue of how to establish 
or ratchet-up standards. It's an approach currently 
popular with certain market-oriented school reformers. 

Currently, only the well-off or those willing to 
make considerable financial sacrifice get to choose 
their children's schools. Wealthy people can afford 

the tuition for private schools. They also can exercise a more common form 
of choice by moving to districts with "good" schools, which are generally, 
though not always, located in more affluent areas. 



Choice's Main Pretext and Its Inherent Problems 

hi simplest terms, those arguing for choice contend that if all parents and 
students, not just the affluent, are allowed to choose the schools their children 
attend, good schools will prosper, bad schools will perish, and the whole 
system will improve. 

While choices are certainly to be welcomed— diversity aids surxiral in 
social as well as biological systems— there are problems with the model just 
limned. The reality is somevs'hat more complex. 

Schools aren't a true ''market" 

For one thing, the market theor)' underlying the use of choice has limited 
application to schools. Theoretically, a true market is infinitely expandable. 
It is possible, in theor\', to sell, say. Coca Cola to ever)'one. 

Schools by their ver)' structure, however, have limited potential for expan- 
si(m. Some have argued that schools will **spring up" like fast food stores 
and g-as suuions where there is a market for them. But it is telling that the 
people who make such argimicnts find their analogies in institutions that 
use unskilled labor and pay low wages. 

Schools, of course, demand people with much tniining and, at their best, 
personal aUributes not found even-where— compassion, humor, and fiexi- 
bility, to name but a few. 



students, not schools, would have to compete 

The limited growth a\ailable to schools would have several repercussions. 
First, like the American higher education system, a full-blown choice program 
would lead to stratification. Limited in expansion capability, colleges that 
attain good reputations become selective. Rather than competition among 
schools, there is competition among students for entry into these highly regarded 
institutions. 

Some individuals, such as Alexander Astin of the University of California 
at Los Angeles, view such a trend to selectivity in public schools as bad.' 
Others, such as James (^oleman of the University of (Chicago, see it as positive? 
(Coleman ()bser\es that schools are already highly stratified by residence, which 
means they are stratified by income and ethnicity. A choice system would, 
in Colemans opinion, simply shift the basis of stratification from race and 
money to merit. 

Psychological discomfort affects placement, attrition 

(iiven the current means of financing schools, most seats in a school 
are resened for children who reside within the designated attendance area. 
The children who live elsewhere must therefore compete for limited space. 
The successful competitors will form a minority and may well feci uncom- 
fortable in a school outside of their neighborhood. This is especially possible 
if they differ, as they often do, in ethnicity from the majority of the district- 
residing children. 

The city of Richmond, N^irginia, became embroiled in a controversy over 
its practice of "clustering" white children together in classrooms. District represen- 
tatives defended the practice on the grounds that in classes with a majority 
of black students, the white children felt left out and overlooked. This is 
probably an accurate feeling on their part, and there is no reason to think 
that children of other ethnicities would feel any differently. Indeed, some 
obseiTci^ have ai)^ied that many choice programs difier little from desegregating 
Centicil High School in Little Rock in 19r)8, except that emotions are more muted. 

The psychi.k)gical discomfort arising from being different from one's peers 
may be one of the reasons a choice program such as Milwaukee s has experi- 
enced high attrition rates! Only 1 percent of MiKraukees population can 
be admit ed to the choice program, yet only about t\. thirds of the available 
places have been used. Attrition was fxS percent in the f. M year, 1^5 percent 
in the second, and 31 percent in the third. 



Since the second year s attrition rate does not differentiate between those 
in the program for the first time and the 35 percent who returned for a 
second year, the first-time attrition rate for the second-year, first-time students 
rnay actually be higher. One would expect those who had spent two years 
in the program to be more Hkely to return for a third. 

The second year's attrition rate is not much higher than the rate at which 
lower socioeconomic students change schools annually, but choice advocates 
have presented choice as a power tool in school reform. In addition, the 
research on the Milwaukee Program found the parents to be more angry 
at the neighborhood school, better educated and more involved with their 
children's education than low-income Milw^aukee parents generally. They do 
not appear as people who would give up on a school or program they liked. 

Parent education becomes an Issue 

Similar results have been found in St, Louis,** In addition, interviev^'s with 
parents in the inner city there found that they knew very little about schools 
other than the one located in the neighborhood and were largely uninvolved 
in their children's education. 

Under a market theon/, howe\er, choice only works well for the consumer 
if the consumer has good information about the product. Given the results 
in St. Louis, parents there and in other locations would seem \ailnerable 
to disingenuous hard-sell tactics in an open market. 

The pattern that emerges from St. Louis and from a longer, broader 
study in the United Kingdom, especially Scotland, is of brighter students 
and children of better educated, more afiluent parents leaving their previously 
assigned schools.^ This, of course, leaves their former schools with a population 
less academically able and more difficult to work with. 

Some such mobility has occurred in the well-regiJ.rded choice schools 
of District 4 in Manhattan. While there is little doubt that District 4— Central 
Park tlast— has \'astly improved what were considered by many the worst 
schools in the city, some of the improvement seen in test scores has resulted 
not from increasing the scores of those attending, but from selecting higher 
scorinjj; students.^ 

The Possible Future of Choice 

The curious case of Proposition 174 may yield some insights on the future 
politics of choice proponents. Proposition 174, a referendum issue voted on 



in California in 1993, offered parents $2,600 to use freely at schools of their 
choice. Although definitive words were hard to come by, one argument against 
the proposition was that anyone who could merely round up 25 children 
could start a school. One stoiT discussed a coven of witches in Northern 
California who planned a school based on their own cosmolog)' and values. 

The proposition was soundly defeated 3 to 1, but it became a cause celebre 
far outside of California. The feeling is that while Proposition 174 was defeated, 
there is a growing acceptance of choice in less radical forms. The California 
Teachers Association, for example, was put in the position of supporting 
choice programs it had earlier opposed in order to argue that Proposition 
174 was not needed. 

Proposition 174 drew the attention of pundits nationwide. At ieast, it 
drew the attention of those who supported it. George Will, in a column called 
"Taking Back Education' vehemently espoused choices cause.' In passing, 
Will claimed that, "Nationalh; about half of urban school teachei^ with school- 
age children send their children to private schools." 

Mixed message 

Tracking Wills claim through a series of consenative school critics led 
to an unpublished paper by Denis Doyle and Terry Hartle." The figure turned 
out to be 21 percent, not "about half" The "about half" number came from 
a convenient generalizati(m of the figure, 46 percent, for Chicago public school 
teachers, 87 percent of whose children were in parochial schools. (A recent 
article has shown public school teachers sending their children to public 
schools at a higher rate than others of the same education and aflluence level.) 

Although Wills published nimiber was false, it quickly made it into the 
popular culture as something that evcncme just "knew" to be tme. After 
my delninking of the statistic was published," I sent one copy of my analysis 
to (leorge \ il!. Will icsponded by sending me a transcript from a segment 
of " fhis Week With David Brinkley" in which he had confronted NEA Presi- 
dent Keith (icigcr with the statistic, (ieigcr responded that it was 40 percent, 
whicli was erroneous. Will tiuis accepted (ieiger s claim over my published 
analysis. Oddly, Denis Doyle, responding to my analysis, was similarly charitable 
toward (iciger's error.''^ 

Some publications perpetuated this misleading message. I sent one copy 
of my analysis to The Wall Street Jounuii That paper did not jniblish it, but 
1 received a letter date(t September 20, 1993, fiom the editorial page editor 
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thanking me for the article ''debunking George Will's column^ I was rather 
surprised and taken aback, then, when a long lead editorial in favor of Proposi- 
tion 174 in the October 25, 1993, issue of the journal cited the statistic with 
no modification or qualification.'^ Although the text of the editorial stated 
that the number was only 18 percent in California, the authors chose not 
to observe that this figure was rather drastically lower than the 50 percent 
stated at the outset. Confronted about the number by yVashbigtwi Post media- 
watcher, Howard Kurtz— editorial page deputy editor, Daniel Henninger, signer 
of the September 20 letter to me, claimed that the precise figures were less 
important than *'rhat public school teachers send their children to private 
school at a higher rate than the general population."*'^ Henninger said this 
in spite of a recent article that had shown public school teachers sending 
their children to public schools at a higher rate than others of the same 
education and affluence level. 

l^he whole stor)' of choice is not yet known because most programs have 
not been in place long enough to make a clt^r^r determination about what 
conditions are required for choice to work. Even now, though, it seems clear 
that choice is not- the silver bullet some have hoped it would be. Harold 
Howe ha> accused market advocates of what he calls '^millennial thinking," 
a tendena' to beliexe that a single reform will cure all ills and bring the 
millennium.''^ Two comprehensive reviews of the literature by Jeffrey R. Henig 
and Peter \V. Cookson seem to l)ear him out.'^ '^ Both find that while the 
claims for choice are powerful, the evidence is quite weak. According to Henig, 
much of the '^success stories'' are casual claims with no real substance, studies 
with inadequate measures to demonstrate the claim, or studies so lacking 
in controls as to render them impossible to interpret. 

Henig s analysis, the most comprehensive and readable of the three, reaches 
a conclusion that stands the market metaphor on its head. Where choice 
has worked, he claims, it has worked not because it has unleashed pent-up 
market forces, but because of those who the marketeers most malign, bureaucrats, 
school administrators, government agents: "The expanded use of choice. , .is 
better understood as having arisen from collective negotiation, public leader- 
sliip and authoritative government, rather than from unleashing individual 
interests and market forces. . .Whether reactive or activist, in all cases the 
process of experimentation [witli choice] has been public and political- 
mediated through collective institutions and made to work through the ap- 
plication of authoritative government action," 



Heiiig and Clookson also obsene that, although the advocates of market- 
driven plans paint them as All-American, the market metaphor is profoundly 
undemocratic: 'The real danger in the market-based proposals for choice 
is not that they might allow some students to attend privately um schools 
at public expense, but that they will erode the public foiums in which decisi(ms 
with social consequences can democratically be resolved. Compared to other 
forces of socialization— the family, religion, and mass media— schools are 
more open to public scnitiny and democratic intenenticmr 

It also seems clear that more will be heard al^out choice. The Protestant 
Christian right has argued strongly for choice and no doubt will continue 
to do so. hi the theologN' of this group, the only legitimate institutions \vc 
the church, the state, and the family. Schooling is the domain of the family, 
and families should have power over it. Families should, therefore, have the 
right to choose what kinds of schooling their children receive and where. 

In their push for vouchers to assist them in choice, the Protestants occa- 
sionally have picked up strange bedfellows as allies, including the Catholic 
(Church. One of tlie hitter's members, former U.S. Secretaiy of Education 
William Bemiett, stumped long and hard for Propositicm 174. 

Bemielt also is affiliated witli < )ne of two largely secular. Republican oi^ani/ii- 
tions lobbying for vouchers and choice, Americans for School (Choice and 
Kmpowcr .\merica. How far these organizations can push their program re- 
mains a question, however. Some obser\ers argue tliat Republicans are largely 
happ\ with their schools, having exercised choice by wliere they bouglit their 
homes. Thev doift think thai the perceived education crisis affects them 
personally. 

According to John J. Miller of the Center for the New American (lommu- 
nity, "School Clioice actually has a narrow and fragile constituencN': con- 
seivative ideologues, the urban poor, and parents with children already en- 
rolled in private schools."*'' Whether this coalition can succeed in pushing 
coice is still an open ([uestion. 

It is conceivable that some people could he convinced to vote lor choice 
because they think it will help other people. The annual Phi Delta KappanlCnxWup 
poll has found that in the last decade, the public's opinion of local schools 
has risen wliile their outlook on the nation's schools has become more gloomv.'' 
It is thus at least tiieoreticallv possible that people could vote for choice 
or other scliool-related issues to solve some problem *\)Ut there." In anv case, 
c hoice issues will be around lor a while. 
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FUWDING 
THE SYSTEM 



CHAPTER EIGHT 

If we wish to take a systems approach and to focus 
our vision at the national level, we can immediately 
see that some parts of the system are w^ell-funded 
and some parts can hardly make ends meet. We see, 
too, that school finance is an area in disarray. 

Equity: A Complex Issue 

Most people agree that funding formulas are not 
equitable now, but they cannot agree on what changes to make. To date, 
some 25 states have had their funding schemes challenged in court, and 
11 funding formulas have been tossed out on constitutional grounds. In 1993, 
the Minnesota Supreme C'ourt upheld a property tax-based funding system, 
concluding that the state constitution does not require an 'identical" educa- 
tion for all students as long as the education of all students is "adequate'' 
The report on this decision did not define ''adequate.'' 

In Michig-an, teachers filed suit to have the courts take over school funding. 
Michig-an Ciovernor John Kngler signed into law a bill that wiped out S6 
billion in property taxes for schools. In a spring 1994, referendum \'oters 
chose a collection of sales taxes as an alternative. At press time, the details 
of the program were yet to be determined. 

Property taxes aren't the answer 

Schools receive funds from states through a variety of formulas. Most 
are sufficiently complex that vcr\' few people understand them. Nor can many 
predict the outcomes of tinkering with them. 

Besides the money sent from the state, a school district receives a percen- 
tage of })r()j)ertv taxes collected in the district. As long as the system is based 
on propertv taxes, there will never be ecjuitable distribution of funds. This 
is so, even if some states, such as Minnesota, hold that inecjuitable distributions 
are nonetheless consiitutional. Some form of progressive income tax or C(m- 
sumption tax is re(iuired. And in all likelihood, the state should function 
as the unit of the education funding system that determines how such monies 
should be allocated to the districts. 

Equal would not necessarily be equitable 

'I'he greatest single portion of even the most adniinistrativelv bloated 
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district is by far that allotted for teacher salaries. Teachers weigh the advantages 
of teaching in a particular type of district against the allure of other aspects 
of the location. Thus, it may be necessary for the districts who can least 
afford it under the present funding system to offer higher salaries in order 
to attract their share of highly qualified instructors. (An alternative that is 
becoming cheaper and more powerful is to use information technology to 
deliver instruction from remote sites.) 

Needed First: A Better Understanding of Funding 

Before we can really address the issue of equity, however, we need to get 
a grip on the reality of what is currently being spent on education and the 
impact of school funding on equity. We also must agree on how important 
money is to education reform, and how much is enough or too much. 

United States is not a big spender 

Critics of the system allege that the United States spends more money 
on education than any other country. As David Berliner of Arizona State 
University observes, former U.S. Assistant Secretary* of Education Chester E. 
Finn, Jr., former U.S. Secretary of Education Lauro Carazos, former head 
of the Council of Economic Advisers Michael Boskin, former chief of stafT 
John Sununu, and President Bush all have made such statements to the medial 
Berliner notes that he has been unable to find any sources for such comments 
and, while he hesitates to call such a statement **a whopper^ he does "not 
believe that anything like reliable information existed at the time to support 
those statements." 

The statements might be true if spending for colleges is included. While 
many countries spend more per pupil than the United States, over 58 percent 
of US. high school graduates attend sonie form of higher education. Another 
10 percent attend postsecondary vocational or technical schools. This is far 
more than any other nation and triple the rate of many European nations. 

Expenditures reported only in per-pupil costs also make it appear that 
the United States spends a lot on its system. The amount is second only 
to Canada. However, v^hen costs arc cast in terms of the Cro.^s Domestic 
Product, America trails many other nations. Calculations by the U.S. Depart- 
ment of Education in the 1992 Ctmdition of Education show the United 
States finishing eleventh of 22 nations in K~12 per capita expenditures. For 



college expenditures, the United States finishes eighteenth? A similar calcula- 
tion by OECD for those 19 nations found the United States 9th? 



Costs have risen only modestly 

The costs of education have risen only modestly, when the costs of special 
education are factored out. The Sandia engineers concluded that the cost 
of $1,600 per pupil per year in 1960 had risen only to $2300 in 1988, when 
a more realistic estimate than usual was made of special education costs. 

Usually, special education costs are figured only as an "add on,'' but the 
Sandia group attempted to obtain figures for such things as overhead. Special 
education costs are real, of course, with some 12 percent of students nationally 
receiving ser\ices. But it is not the case that we are "throwing money'' at 
schools. 

Money does affect achievement 

Some conser\'ative critics of schools contend that money is of little import, 
that it has no impact on achievement or the productivity of schools. We 
should not, they argue, "throw money at the problem.'* Eric Hanushek, for 
example, conducted the best known analysis of the relationship between money 
and outcomes and claimed to find no relationship.* 

More recent analyses, however, have indicated that money does matter. 
A second look at Hanushek's data by Keith Baker showed it to actually favor 
a "money matters ' conclux^ion. Hanushek did not ask the right question nor 
test his hypothesis properly. 

Hanushek looked at the level of achievement. If one looks at changes 
in achie\'ement with increases in money, the relationship clearly is present. 
But Hanushek did not perform the proper analysis to reach the conclusions 
drawn in his review of 65 studies. The studies are cast only in terms of statistical 
significance.^ 

The question asked is, "Did more money lead to more achievement?" 
Statistical significance tests cannot answer this question. They cannot deter- 
mine if treatment ^1 produced more gain than treatment ^ (although such 
tests are often misused in this way). Statistical significance tells you one thing 
and one thing only: how likely it is that the difference you found could 
occur by chance if the two samples actually came from populations with the 
same mean (zero difference). Nothing more, nothing less. Bakers analysis 



of Hanushek's data, cast simply in terms of their direction, finds 38 with 
a positive relationship and only 16 with a negative relationship. 

In the April 1994 Educational Researclier, Larry Hedges and colleagues from 
the University of Chicago took another look at precisely the same array of 
studies that Hanushek had used? Hanushek had analyzed the data with a 
relatively primitive *\'ote counting ' method. Hedges and colleagues use a 
much more powerful version of meta-analysis. By this technique, Hedges et 
al find that adding only $500 would increase achievement by an effect size 
of .7. This is an enormous impact. An effect size of .7 is the equivalent of 
taking a student at the 50th percentile and moving him or her to the 76th. 
Hanushek thinks this effect size is unrealistic and the issues probably are 
not resolved in terms of exact amounts, but it appears clear that money matters. 

A recent study conducted by the American Legislative Exchange Com- 
mittee, under the oversight of former US. Secretar)' of Education William 
Bennett, also claimed to find no systematic relationship between money and 
achievement.' Achievement this time was measured in terms of state averages 
on the SAT compared with their per-pupil expenditures. 

Syndicated columnist George Will noted that the five leading states (Iowa, 
North Dakota, South Dakotii, Utah, and Minnesota) were all low spendei^s; 
while New Jersey, which spends more per pupil per year than any other state, 
finished only thirty-ninth in the Great SAT Race.** What Will did not mention, 
of course, was that in the five top states, virtually no one takes the SAT. The 
percentages for the states in 1993 were 5, 6, 5, 4, and 1 1, respectively. In contrast, 
in lowly New Jersey, flilly 76 percent of the seniors huddled in angst on Satur- 
day mornings to bubble in answer sheets. (Students in the top SAT states 
mostly take the ACT )atten'.) 

Some nations recognize that money matters or at least act as if it does. 
Iris Rotberg has obsened that in some countries, where the federal govern- 
ment controls resource allocations, poor districts receive much more money 
than rich districts? 

In Sweden, for example, per-jnipil expenditures in low-income schools 
are two to three times higher than in affiuent schools. Such disparities occur 
in the United States also, hut it is the rich districts that typically spend the 
most money. The 100 poorest districts in Texas spend an average of just 
under $3,000 per student. The 100 wealthiest districts spend about $7,200 
per pupil. In Illinois, school district spending varies roughly between $2,400 
a.'d $8;^00 per student. 
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As for the claim that throwing money at the problem is useless, Rotberg 
comments that, "this is true only if one assumes that offering poor children 
the opportunities routinely available to their more affluent peers is the same 
as throwing money at a problem. Teacher expertise and experience, class 
sizes, better science laboratories, and decent facilities do matter. If they don t, 
rich school districts haven t heard the message." 



Intensive Care Needed for the Most Disadvantaged 

While the relationship between money and achievement is positive, the proper 
relationship between money and achievement is negative. It is negative for 
the same reason that the relationship between expense and sur\i\'al rates 
in hospitals is negative: Those conditions requiring the greatest expenditures 
still have the least favorable outcomes. 

Who would think that, with identical funding, an inner-city school would 
attain the same level of achievement as a suburban school? Bella Rosenberg 
of the American Federation of Teachers has commented that we ought to 
treat inner-city schools as Intensive Care Units w^ith all of the special attention, 
expertise, and equipment that implies. 

Jonathan Kozol, in his book Savage Inequaliiies}'^ describes inequities that 
most assuredly contribute to performance deficits. Clearly, such schools are 
in dire need of resources. Yet an analysis by the Council of Great City Schools 
showed that, on average, cities receive $900 less per pupil per year than nonur- 
ban areas." 

Of course, it is not just the cities that are in trouble. The Population 
Reference Bureau''^ concluded that the United States has a mral underclass 
about half the size of the urban underclass, but where problems are even 
more intractable. The mral poor are seldom seen because they are dispersed 
across the countmide and can t org-anize to demonstrate before television 
cameras, most of which are in cities anyway. 

One stoty about this nn-al underclass told of districts in Michigan and 
Indiana sending obsolete textbooks to Alabama and Mississippi where they 
were received as '*<odsendsr The Midwest districts also sent desks and chairs 
since there weren^t enough of those to go around either. A recent article 
on trends in the Mississippi Delta spoke of emerging towns that have lost 
almost all of their propcrt) tax base. "We have 1,476 people, but we may 
have 100 who actuallv work," said the former mavor of Jonestown.^ ^ And 
in a re])()rt on the condition of Alabama schools carried on the Deceml)er 
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1993 edition of National Public Radio's "All Things Considered," an Alabama 
historian observed that some science textbooks in Alabama declare that "man 
may some day walk on the moon." 

The results of such fiscal neglect are all too obvious: Simply remember 
the effects of poverty on student achievement noted in chapter 2. 

The Washington, D.C., public schools give us a specific example. Though 
this district is a frequent target of criticism, it never has been labeled the 
worst in the nation. Yet only 60 percent of the students graduate. Only about 
25 percent of these take the SAT (compared to upwards of 80 percent of 
students in the surrounding suburbs).^' The average total SAT for 1992 was 
705. If we assume that those taking the SAT are academically the brightest 
and most highly motivated, then the average District of Columbia SAT test- 
taker barely qualifies to play freshman varsity athletics. (The NCAA's Proposi- 
tion 48 requires a combined SAT total of 700 for freshman eligibility.) 

Commitment to the long run 

The funding inequities and their consequences described in this section 
are hardly revelatory. Without a significant paradigm shift, though, it is unlike- 
ly that they will be dealt with properly. One explanation for the neglect comes 
in the terms of John Kenneth Galbraith's "culture of contentment''^': 
If poor schools received more money, those who pay taxes would 
have to pay more. Thus, good schools in cities and poor rural areas 
cost "us" and benefit "them," at least in the short run, and is therefore 
something to be avoided. In the long run, however, the situation is 
different. 

To change our education system, Americans must take up the habit of 
looking at social problems and their solutions in the long run. 
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CHAPTER NINE 



THE. 

PURPOSE 
QFTHE • 
■SYSTEM AND 
ITS GOALS ■ 



To this point, this treatise has stressed the need 
for a systems approach— the need to look at and 
fund the \.iiole system— without defining the system. 
It has mentioned Israel Scheffler's definition of educa- 
tion, but has not really discussed what the syst em 
is supposed to accomplish: What are the aims of educa- 
tion? And more broadly, of society through education? 

Unlike many systems, the American educational 
system was never laid out with a grand, single-minded 
plan. Quite the reverse. In many cases, parts of the system changed function, 
other parts were grafted on, and some just "growed like Topsy." We have 
been better at specifying in general the benefits expected near the end of 
the high school and college components than in the early school years, but 
a systems approach requires us to decide what we want at each level. It requires 
benchmarks, as discussed in Chapter 6. 

In that chapter, it was proposed that quality be specified in terms of 
the next level of consumer of the system's "product." But these would be 
ratlier technical specifications in terms of competence, skills, and knowledge 
(such as what a freshman student has to be able to do to get a "B" on an 
English paper). They do not address overall purpose. 

Philosophical Barriers To Defimi^ Education's Purpose 

It is possible that we cannot speak with a single voice on the nature of purpose. 
Aristotle, after all, argued that education addressed "the good life" and, since 
people will have different and irreconcilable ideas about what the good life 
means, this inevitably places education in the political realm, perhaps with 
irreconcilable differences among actors. 

For example, most calls for reform have included a "critical thinking" 
component early in the curriculum. But some Christian fundamentalists op- 
pose such teachings before age 16. It is not just that they have serious objections 
to the presence of certain creatures — witches, for example— even appearing 
in cun icular materials, where more secular groups would not take such ap- 
pearances seriously. The shift to learner outcomes implicit or explicit in many 
critical thinking programs is an intolerable shift to some. It shifts the emphasis 
from teaching, which is the proper instillation of absolute knowledge and 
values, to individually constructed learning, an inappropriate shift toward 
relativism. 



In Pennsylvania, a program of "Outcome-Based Education" (OBE) was 
substantially modified after sustained attacks from religious gioups who held 
that some of the outcomes invaded the realm of values that should be left 
to the family. Although the critiques of a similar proposed program in Vi rginia 
were couched largely in terms of the costs, clearly a similar concern with 
N-alues undergirded the critics' comments. Pressure from critics in Virginia 
caused then-Governor Wilder to abandon the OBE-formulated Common Core 
of Learning. Attacks on OBE have arisen in other states, and more can be 
expected. According to Fritz Detwiler, the Protestant Right has declared, in 
their words, civil cultural war on the larger society.* 

Similarly, while the earlier definition of education from Scheffler includes 
the development of character, some would argue that character development 
is not proper for schools. This argument is understandable but misguided. 
One aim of education is to prepare students to participate in a democratic 
society. The education for such must include shaping dispositions to act in 
accordance with democratic principles. 

This is quite a different education than one to prepare a person to par- 
ticipate in a totalitarian society. In totalitarian states, thinking critically or 
questioning values is not only not rewarded, it can be punished by jail or 
death. In a democratic society, on the other hand, one must be able to decide 
among a variety of claims, all competing as "the truth.'* 

Definitions of Years Past 

It is worthwhile to take a look at the advantages of education, as enumerated 
by Benjamin Rush, an educator and political commentator and signer of 
the Declaration of Independence. In 1786, Rush had this to say: 

• It (education) is friendly to religion inasmuch as it assists in removing 
prejudice and superstition. 

• It is favorable to liberty. Freedom can exist only in a society of knowledge. 

• It promotes just ideas of law and government. 

• It is friendly to manners. Learning in all countries promotes civilization, 
and the pleasures of society and conversation. 

• It promotes agriculture, the great basis of national wealth and happiness. 

• Manufacturers of all kinds owe their perfection chiefly to learning.^ 
A hundred years later, John Dewey asserted that education "is the funda- 
mental method of social progress and reform'*^ He believed any reforms that 
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"rest simply upon enactment of law. . .are transitory and futile." Education 
must regulate the relationship between the individual and "the social con- . 
sciousness ... in the ideal school, we have the reconciliation of the individualistic 
and the institutional ideals." 

The Need To Go Beyond Knowledge 

Grant Wiggins has argued the effects of education on democracy' and social 
progress from a similar perspective. He challenges us to stop treating students 
as passive receptacles (and many who give lip service to a constructivist ap- 
proach to learning actually do). If we treat students instead as "intellectual 
apprentices," we could ultimately develop in them not just knowledge and 
skills and how to use them, but a "style." 

To see the word style in the context of education will likely surprise many, 
but it :houldn t. Ultimately it is what we like and respect most about other 
people. Would we pay to hear a pianist who had no style? Music without 
style is Muzak! Learning and the life of the intellect also cm be approached 
with style. 

Optimization of learning must be the overriding goal 

For the purposes of this report, we can agree that the goal of school 
is to optimize learning— whatever it is determined that students should learn. 
That "whatever" will likely have to be left, at least in part, to local decision * 
makers. As William H. Clune of the University of Wisconsin has stressed, 
the country is far too diverse to do otherwise.* 

However, to say that the goal of the system is to optimize learning for 
all students is to radically change the system's goals from what they have 
been historically. 

American schools have not always been expected to teach a lot to everyone. 
Until recently, for most people in the country, a strong back or a deft hand 
was sufficient to ensure, if not wealth, a decent standard of living in a manufac- 
turing society built around the assembly line. The rapid repetition of small 
tasks was then the hallmark of eftlcienc)'. 

Schools that prepared the bulk of Americans for such jobs while sending 
an elite on to higher education were sufficient to ensure both a supply of 
laborers and managers, and generally, to keep the country prospering. 

The American school, in essence, was, as it s been called, "the great sorting 



machine'' It sened as a device for deciding who gets society's greatest rewards, 
and it mostly benefitted white males. 

Current goals focus is limited to jobs, competition 

In the decade since * A Nation at Risk," the discussion of goals and purposes 
has been debased by a dreary instrumentality. Most discussions start and 
stop with contentions about only two of education's purposes, seen as co-equal: 

1. Securing good jobs for individuals; and 

2. Securing international competitiveness for the nation. 

Diane Brady, an associate editor at the Canadian magazine, MacUan\ 
writing in the September/October 1993 issue of Mother Jones, caught well the 
thrust of an argument that has been espoused by people as diverse as Lamar 
Alexander, Lauren Resnick, Albert Shanker, the SCANS Commission and, 
really, a host of others: 

For years, Americans have complained that Johnny can't read. 
In the booming postwar economy, it didn't seem to matter. ... It didn't 
matter what he learned, so long as Johnny could get a job and buy 
a house in the suburbs. . . 

The good life will be harder to achieve in the coming centur)'. 
Today's schools actually may be no worse than those of 20— or 50— years 
ago. Nonetheless, they aren't good enough. American students need 
to be better educated if they are to compete in the global arena.^ 
As historical analysis, Brady's treatise is simplistic. The relationship be- 
tween the education of the entire populace and international competition 
has yet to be documented. But it is important— as we seek to prepare the 
workers of tomorrow and set related goals— to understand the changes in 
the workforce. 

According to Lawrence Mishel and Ruy Texeira in The Myth of the Comirig 
Lcihor Shortage, there's been a shift toward a more skilled workforce for about 
three decades. And while this shift is slowing rather than accelerating, it 
contiiiues nevertheless.^ While 75 percent of American labor remains organ- 
ized around simple repetitive tasks, the more productive and competitive 
corporations have pushed complexity and decision making down to the lowest 
possible point. They have made work "smart" and int.reased the skill levels 
for even the lowest jobs. 

Thus, while schools formerly could be considered successes by providing 
most people with "basic skills," the typical skills considered previously as 
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minimal are, in many instances, no longer even thai. Since "A Nation at 
Risk." the coimtr>' has come to expect schools to provide students with skills 
that will permit them to succeed at these more complicated jobs. 

Trend is toward service-sector jobs 

The perceived need for increasingly skilled labor has been used to increase 
the focus on learners in schools (as opposed to on-the-job training). At the 
same time, it must be pointed out that, while business and industn' assert 
they need more skilled labor to increase productivity in some jobs, the trend 
in recent years has been toward producing more and more low-paying, ser\'ice- 
sector jobs and eliminating better-paying manufacturing jobs. 

While the fastest growing jobs in terms of rates of increase all involve 
skilled labor, these jobs account for a tiny fraction of all jobs. By one estimate, 
the top 10 fiistest growing jobs requiring skilled labor account for only 4 
percent of the total labor force. On the other hand, the largest three job 
categories and fastest growing in terms of numbers account for many more 
jobs: janitor-maid, waiter-waitress, and sales clerk. In 1992, as manufacturing 
shed 255,000 jobs, the restiiurant industi7 alone added 249,000. 

B\- 2000, the three fastest growingjobs (paralegal, medical assisUint, radiologic 
technician) in terms of rates v ill account for a projected 616.000 jobs.' " The 
three low-paying categories accounting for the most jobs, however, will account 
for 10351.000. Tourism is America's largest growing industry, but it does not 
otter many high-skilled or high-wage opportunities. 

In sum, we need to realize there are limits as to how many skilled employees 
the labor force can absorb. High school dropouts, high school graduates, 
and those with one or more years of college education are all more likely 
to be working for low wages than 15 years ago (low wages being defined 
as $12,000 a year or under in 1991). The number of students with college 
degrees who are working in jobs that require no college continues to increase, 
with estimates ranging from 18 to :W percent. Dcmogi .ipher Harold Hodgkin- 
son discovered that :i5 percent oi' the students in one connnunity college 
already owned bachelor's degrees and were now looking for more practical 
skills. ■ 

During the NAF TA debates, Ross Perot kept wondering why the people 
wlu) carried his hags at hotels all had college degrees. The "B.A.-bellboy 
phenomenon" was grist for several articles. In one, a college graduate wus 
reported as saving, "We're getting jobs chimps could do." The lucky ones. 
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claimed the article, were getting positions offering such challenging activities 
as photocopying? 

Education will continue to affect wages* This large number of college 
students looking for jobs and taking menial ones does not mean that the 
value of education is declining. Quite the contrary'. The percentage of people 
holding low-paying jobs has risen most rapidly among high school dropouts. 
More importantly, the wage gap between those in low- and high-payingjobs— 
which require more education— has increased. 

A study by Princeton economists Orley Ashenfelter and David Krueger 
of identical twins who had different amounts of education found that each 
year of education added about 16 percent annual income.'^ That is, if one 
of the twins had a high school diploma and the other a baccalaureate degree, 
the college grad would earn on average 64 percent more per year. 

A chart in the February 3, 1993, issue of Education Week painted an even 
more dramatic picture. The chart did not control for genetics, but it showed 
that in 1990: A high school graduate earned $1,077 a month; a person with 
an associate degree garnered $1,672; a college grad, $2,116; a person with 
a master s, $2,822; and a person with a doctorate, $3,855. High school dropouts 
drew a meager $492." 

Learning also should be a goal in itself 

The push for more education for all citizens is not only job-related. Society 
as a whole has recognized that education brings benefits other than increased 
skills and the salaries they command. Educated people live longer, healthier 
lives and may even be happier, though the nature of happiness remains elusive. 
In any case, one way to keep life from being nasty, brutal, and short is through 
schooling. 

Society also has come to value, at least with lip-senice, the idea and 
ideal of lifelong learning. In pait, the growth of life-learners— people con- 
stantly renewing themselves with new information, new skills, and new 
perspectives— has become a societal goal, valuable in and of itself Some years 
ago, e>amining trends in literao expectations, historian Daniel Resnick and 
cognitive psychologist kuuen Resnick effectively documented the historical 
shift from a society expecting low literacy for many and high literacy for 
a few to a society expecting high literacy for all.'^ 

Literacy and skills arc needed for both personal and professional survival. 
In many professions, the needed skills change rapidly. The half-life of much 



knowledge is now only a few years. More and more industries are moving 
in the direction of re-skilling people often. A person who has one set of 
skills and is unwilling, or unable, to learn new ones may well tind himself 
rapidly b .coming obsolete and unneeded. While many have put forth the 
argument for a more highly skilled workforce, the most important quality 
in a worker— and a citizen— may well be flexibility. 

In the summer of 1993, an educational conference in Toronto provided 
an eye-popping experience. There, people were speaking of education in the 
terms used by Jefferson, Rush, Dewey, and Scheffler. Some even dared speak 
of education as a pursuit of truth. 

It is hoped that, as we begin anew to define the goals and purposes of 
education, we think beyond its economic consequences for individuals and 
nations. 
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CHAPTER TEN 



CHANGES IN 
LEARNERS: 
IMPACT ON 
. THE SYSTEM 



Students who attend school today differ in many 
ways from those of prev ious generations. Although 
ihey learn in the same ways, using the same psycho- 
logical processes, their capacity for learning and their 
style of learning are affected by a variety of influ- 
ences—some of them good, some of them bad. 
Seymour Papert has argued that a doctor from 

1894 would literally be lost in a hospital of today— 

computers and technology have so re\'olutionized medi- 
cine.^ He also contends that a teacher from a century back would feel right 
at home in today s classroom. That might be true of its physical nature. But 
a good guess is ^^at a post-Victorian teacher would last about 10 minutes 
with today's chilaien. 

The field of educational demographics permits us to examine the 
demographic characteristics of the learnei^s entering the system and, thus, 
attempt to predict what kinds of pressures they will put on the system, as 
well as what kinds of changes they may require of it. In Chapter 2, we discussed 
some of the economic and societal issues that are undermining today's grad- 
uates. These included poverty, lack of immunizations, low birth weight, single 
parenting, and crime. And it appears that these concerns are only getting 
worse. For the class of 2010, those children born in 1992, for example, we 
know that 23 percent were born in poverty and 50 percent were born to 
a single parent. But other factors affect the nature of learners that school 
systems must address. One of the most prominent ones, perhaps, is a growing 
diversity. 

We Are Less of a ^'Melting Pot'' Than Ever 

Americans have always characterized themselves as a nation of immigrants, 
although they have sometimes been naive in evaluating what happens to 
immigrants once they reach these shores. The "melting pot" did not, of course, 
homogenize them in the fashion once claimed by early sociologists. More 
recently, some have come to realize that poems and slogans of 70-odd years 
ago that characterized the United States as a ^'nation of nations'' really should 
have portrayed the country- as a nation of Europeans plus two oppressed 
minority groups. 

Harold Hodgkinson is fond of noting that if "Anglos" went to a concert 
of these earlier immigrants music, they would recognize it as their own. If 
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Anglos were to go to a concert of the music of the new immigmnts, however, 
it would stretch their range of accommodation to understand w^hat was going 
on. The tonal systems, the rhythms, the harmonies are different and unfamiliar 

The question arises as to whether America s new immigrants will be able 
to, or will wish to, follow the path of the earlier Europeans, which led to 
their moving up both the economic and educational ladders. In any case, 
these students will put additional stresses on the educational system, if for 
no other reasons than that many of them come from poorly educated families 
and do not speak En^^ish as a native language, (In four of the nation's most 
populous states— California, Florida, New York, and Texas— 32 percent, 17 
percent, 23 percent, and 2b percent of the population, respectively, speak 
a language other than English at home. 

The stresses described abcne will require more resources, both money 
and time. But this requirement will be borne by an aging population. In 
1970, 34 percefit of the population was under 18; in 1990, only 26 percent 
were this young. B\' 2000, this figure will fall to 25 pe- We already spend 
$11,000 a year on each pei^son o\er the age of 65, and onh' $4,250 annually 
on even-one under the age of 18.' According to Hodgkinson, all groups vote 
their interest. Children, of course, do not vote, so it will become even more 
difficult to get the resources to meet their needs. 

Children Are Less Ready 

Nowhere does the change in constituents show up more dramatically than 
in the preschool years. The disadvantage experienced by disad\'antaged children 
begins immediately, startiivr with the lack of prenatal care and immunizations 
noted in Chapter 2. In ad(ntion, poor children are more likely to be exposed 
to a variety of environmental hazards such as leaded water, as well as to 
the consequences of poor nutrition. 

lliis flies in the face of Americas first National Education Goal— that 
all children will arrive at school ready to learn. In fact, Ernest Boyer, in 
Ready To Imrn. found that 42 percent of all kindergarten teachers believe 
children today are less ready for school than even those of five years ago. 
Only 25 percent said diildren were more ready;* 

Since Boyer s analysis does not dissect the responses by socioeconomic 
differences among the students of teachers gi\'ing different responses, one 
can guess thai those saying "more ready" had in mind more affluent students 
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than did those saying "less ready." Among those teachers sa\'ing children 
are less readv, howevei, language deficiencies were the most commonly reported 
problem. It's worth noting that ovenvhelniingly, these same teachers said that 
parent education would do the UK/St for childrens readii^.ess. 

Day care, preschool insufficient 

Of course, readiness is greatly affected by the care and attention children 
receive earlv on— which, for many (especialK the poor) isn't adequate. There 
is Head Start for poor children, but it has never received full fu!iding. 

According to Boyer, only about 40 percent of children whose families 
earn less than $4(),()()() attend preschool. Tlie Condition of Education 1993 shows 
about 22 percent of low-income families enroll their children in preschool, 
compared to percent of middle inc(mie families, and 33 percent of high- 
hicome families (see Figiu'e lO-A). 

FIGURE 10-A 

Our Readiness Goal Eludes Us 

The first Naticmal Kducation Cioal is to have all children arrive at school 
readv to learn. The preschool enrollment patterns, however, suggest that we 
are moving farther awav from that goal. High-income families are much more 
likelv to enrol! their children in preschool than are middle- and low-income 
families, hi addition, prognnns offered at high income preschools focus on 
cognitive development, while those offered at low income preschools often 
are more custodial. 




These percentages do not address the issue of what is going on in the 
various preschools. We can surmise, though, that children of low income 
families are more likely to receive custodial care than care that develops social 
and intellectual skills. A friend related how a clerical worker in his office 
reported that his daughter was having trouble sleeping at night. In conversa- 
tion, the parent revealed that the woman w^ho ran the day-care center his 
child attended kept the house dark and encouraged the children to be quiet 
and still, even to sleep. Not exactly a recipe to enrich a growing brain. 
The opening paragiaph of Boyer's Ready To Ijearn reads as follows: 
America is losing sight of its children. In decisions made every 
day; we are placing them at the very bottom of the agenda, with grave 
consequences for the future of the nation. It's simply intolerable that 
millions of children in this country are physically and emotionally 
disadvantaged in ways that restrict their capacity to learn, especially 
when we know what a terrible price will be paid for such neglect, 
not just educationally, but in tragic human terms as well. 
But of course, it is tolerable in the sense that w^e tolerate it and do little 
to nothing about it. The 1971 White House Conference on Children declared 
that child care was one of the most pressing problems in the nation, but 
scant progress has been made in addressing it. 

Comprehensive approach needed 

Many people have acknowledged that not only should we provide more 
care for children, but that we should package this care in a comprehensive 
program. Boyer observes this in Ready To Learn, as do documents of the Child 
Care Action Campaign. 

A comprehensive approach to child care could generate many benefits 
of which better care is only one. A comprehensive approach could make 
better care available more efficiently and more effectively than what Boyer 
calls our current '^chaotic nonsystem.*' In addition, a consolidation of child 
care provisions would articulate the preschool years with the kindergarten 
and eiementar)' years. Accomplishing such a consolidation will not be easy 
and will have to take place at many levels. 

Of such a consolidation, Michael Kirst writes that: 

The attempt to improve the current nonsystem must proceed from a 

grasp of the deeply rooted causes of its fragmentation. Problems start 

with splintered professional preparation on the university campus. 
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Educators go to education schools, social workers to social welfare 
schools, health professionals to schools of medicine or public heaJlh, 
juvenile justice workers to criminolog}' schools, county executives to 
public administration schools, and so on. There is rarely any inter- 
professional education or contact during the staff development pro- 
grams of a professionals career. Different children's serxice systems 
have separate intake and assessments procedures and infornration 
systems that cannot be aggreg-ated.^ 

Neither Royer nor Kirst directly address one important reason for an 
improved child care system: the disappeanmce and disarray of parents. Teachers 
increasingly report that parents are so consumed with holding their own 
lives together that they lack the requisite time, energ\, and understanding 
to help their children grow. 

Quality care as an investment 

The provision of quality day care and other child social senices should 
be seen as an investment, not an expenditure. Shortly after being elected, 
President (Linton was heard to say on several occasions that we get three 
dollars back for eveiy dollar in\'ested in day care. Later he stopped making 
this utterance, j)robably because staffers told him that the tigine came from 
onlv (me luueplicated study, the well-known Pern- Preschool Project in Ypsi- 
lanti, Michigan. 

While it is tnie that this study has not been replicated, other studies 
suggest that the results are replicablc. The payback, as ivcently calculated 
for the children, now age 27, is not S3, but S7.Hi^ Also: 

• The group that did not attend preschool was five times more likely to 
have five or more arrests, and (me-fourth as likely to make over $2,000 
a month. 

• More than twice as many of those who had attended preschool owned 
their own home. 

• Fewer in the preschool group had ever been on social senices. Seventy- 
one percent had graduated from high school, compared to 54 percent 
of the control group. (Readers should recall that students in the study 
were randomly assigned to experimental and control groups, a procedure 
that minimi/es the chance that the two groups started with cognitive 
differences.) 
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Some might argue that the Pern' Project stands out in comparison to 
other program disappointments that led Arthur Jensen to his famous com- 
ment, "Compensatory education has been tried, and it apparently has failed.''® 
The operative word in Jensens pronouncement, however, may well be 
"apparently.'' 

On the other hand, W. Steven Barnett of Rutgers University reviewed 
a series of studies examining the long-terai impact of preschool and found 
them largely positive/ IQ gains, always seen initially, do seem to fade over 
time, but other outcomes such as grade retention, special education placement, 
and gi^aduation rates favored preschoolers. 

Barnett also found that many studies did not match experimental and 
control groups properly in testing programs. As the children progressed through 
the year, the control group came to contain more and more retained children. 
Although such children score low, they score better the second time around. 
Had the experimental groups been tested only with age mates, they would 
have scored higher on achievement tests. 

Children suffering neglect today will be expected to be taxpayers, social 
security contributors, and even our civic leaders 25 years from now. Is that 
a reasonable expectation? 

The evidence seems to support Barnett's contention that a $14 billion 
investment could purchase the nation a preschool program as good as the 
Perrv' project. The consequent lack of attention to children's development 
is thus not understandable and will doubtless come back to haunt us. 
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CHAPTER ELEVEN 1 

According to philosopher Michael Heim, the com- 
puter already has had as much of an impact on 
most of society as Gutenberg's printing press.' Unfor- 
tunately, the information technology revolution that 
has so changed the world outside of education has 
made only modest inroads inside the schoolhouse. 




The Uyih of the 
Technological Revolution 

Indeed the historical relationship between technology and the schools has 
been tenuous and uneasy, full of unrealized promise. Over the last century, 
many visionaries have promised a revolution in learning as a result of changes 
in technology'. But the revolution never came. Beginning with educational 
radio through film, educational television, videotape, and B.F. Skinner s teaching 
machines, the new technologies have made brief appearances m selected sites, 
after which many teachers relegated the various machines to secondary roles 
or the closet. Even in 1991, Henry Becker of the University of California 
found that most teachers who used computers were still using them as ancillary 
devices, supplementing the core of the curriailum. often with dnll-and-practice 
exercises. Only a small proportion of teachers had integrated the machine 
into the central parts of instruction. 

A question of control 

The older "technologies" maintained the traditional situation in which 
the teacher controlled the information. This approach, while probably never 
optimal, was at least satisfactory during days past when knowledge was scarce 
and had to be sought out. h is easy to see how, in eras of less than immediate 
information exchange, schools and colleges earned their positions as places 
from which knowledge was dispensed by the few who had it, to the many 
who did not. , „ -r ^ nnc on 

In the late 1970s, with the advent of the Apple II. Tandy lRb-«U. and 
Commodore PET computers (the first of the machines to be called "personal- 
computers), the condition of knowlcdge-as-souce-resourcc began lo change. 
The control of the flow of knowledge began to pass to the learner. In the 
hyper-swiftly changing world of information technolog)', these machines are 
now dinosaurs. 



The Apple II had the largest brain of the three, a memory of 16,000 
bytes, expandable to 64,000, and no storage. Machines today that sell for 
half what the Apple II cost come with 4 million bytes of memory. Plus many 
are equipped with 300 to 400 million bytes of storage, necessary because 
the memory needed for complex word processing, spreadsheet, data base, 
and graphics programs take several million bytes each. Actually, "snail" is 
a more appropriate metaphor for the early computers than dinosaur. Not 
only did these machines have small brains, they were, compared to current 
computers, incredibly slow. 

The educationally critical aspect of the new computers is not, however, 
their memory or their speed. It is that they permit the user to interact with 
the machine. This is even more evident in dramatic technologies such as 
interactive videodisc. Children, despite often being characterized as couch 
potatoes addicted to television, do not like to be passive. Children's television 
entertainer Shari Lewis, for example, has found that she gets better involve- 
ment when she has her puppet, Lambchop, perform a routine that requires 
that the children sing and act along with it. This, of course, is precisely what 
cognitive psychological theory would predict. 

Barriers to the Use of Computers in Schools 

Schools have been slow to adopt the new technologies for a \'ariety of reasons. 
In addition to skepticism arising from earlier techno-follies, cost has been 
a major factor, ignorance another. Even during the early days of personal 
computers, one person commented that what educators were doing with these 
machines was like asking a symphony to play scales. Given the power of con- 
temporary machines, it is more like assembling the forces needed for a Mahler's 
"Symphony of a Thousand" and repeating only a single note. 

Administrators not plugged in 

Many of those in a position to purchase computers did not realize their 
potential. It is not uncommon today to find high-powered machines in the 
offices of senior school administrators— with the power off. This generation 
did not grow up with computers and they feel they cannot take the time 
off from their frenetic schedules to learn about them. 

In the offices of these administrators, the secretaries are usually competent 
with word processing procedures. Some can use spreadsheet programs, and 



a few can operate data base and graphics packages. These, for all the tremen- 
dously increased speed and power they offer, do not reveal to the administrators 
the fijll range of computer uses. 

Indeed, many administrators see only the end products of the process, 
which often resemble merely more professional-looking versions of the old 
product. Not seeing what computers can do, this generation of administrators 
is not in a position to advocate their use. This may be why, in the early 
days of pei-sonal computers, they were most often introduced to school systems 
by individual teachers who were computer "buffs." 

Cold feet, trepidation was norm 

Computers' adrance into the classroom was slowed for another reason: 
fear From the early days of computer-assisted instruction, researchers such 
as Patrick Suppes spoke of using the computer to provide e^ery child with 
a wise Socratic interrogator. More than other technologies, computers were 
touted in some quarters as replacements for teachers. Little wonder that they 
made teachers apprehensive. Recent studies have shown that only after some 
years of computer use do teachers become comfortable with the machines 
and feel that they "at least know as much about the machine as the kids." 

Then, too, early computers were not especially "user friendly" and little 
help was available to those who ventured into the field. Computer wizards, 
supposedly there to help, often assumed people not intimated with the machines 
knew more than they actually did— or they would baffle them with dialogue 
peppered with techno-jargon. In addition, people who wanted to write their 
own software usually had to cope with BASIC, a weak and cumbersome language, 
never intended for widespread popular use. 

Impact of tlie barriers 

This fear and anxiety set up a somewhat vicious qcle: Because educators 
used computers tentatively, software manufacturers would not risk large in- 
vestments to develop the kinds of powerful software packages that they brought 
out for business use. Because the software was not always of high quality, 
schools were slow to acquire it. 

In addition, becaiis" computers often entered schools through the agenc)' 
of some lone "computer buff' who cajoled the school or, less likely, the school 
district, into acquiring machines, computer use and setup \vas disjointed. 



The computers often ended up causing more problems than they solved, 
not to mention embarrassment. 

Happily, now it is more likely that a principal or a committee will act on 
behalf of a school or district. As Henry Becker has found, contrary to most 
areas of change where top-down control is ineffective, such centralized plan- 
ning for computei use works better' than grass roots, bottom-up acquisitions? 

Benefits of Use Beginning To Be Realized 

Becker also has found that computer use is changing, if slowly, and benefits 
are accruing as some teachers do deploy the machines as integral parts of 
their instruction. One recent report show^ed that with computers applied to 
administrative tasks, teachei^s saved an average of 36 minutes a day, a savings 
that amounts to tacking on three weeks to the school year. 

A number of studies have found that students using computers learn 
more and enjoy the experience. Indeed, the affective benefits of computers 
have often outweighed the achievement benefits. As one would expect from 
the tenets of cognitive psycholog)', students appreciate being able to move 
through material at theii* own pace, and to make mistakes without feeling 
censured by the teacher or classmates. 

Possibilities beyond computers 

As noted, new generations of technology usher in new possibilities. Indeed, 
the quantitative changes in productivity discussed above, while certainly welcome, 
pale in significance compared to the cmlitative changes the computer in- 
troduces into the process of schooling. 1 hese changes take two forms: in 
the nature of teaching and in the nature of what it is possible to teach. 

We have spoken largely of computers to this point. But computers occupy 
only one niche, if a currently dominant one, in the space allotted to informa- 
tion technology'. Indeed, the titl< of this chapter suggests an antiquated notion 
that adding new technologies re(iuires only that we find more AC outlets. 
In fact, the larger revolution is in terms of what is occurring in telecommunica- 
tions technologies. In particular, the capacity of fiber optics to deliver huge 
(juantities of information has led some speculators to conjecture that we cur- 
rently have our fiiture telecommunication systems reversed: Hver)'thing that 
is now sent through the air will ewntually I)e sent via fiber optics, and eveiything 
that is presently delivered by wires will be sent thiough the air. Whether 



this prediction comes true or not, clearly we are in for major changes in 
the way we use information. 

Examples of what's available To take a modest example, art teachers 
often use slides to accompany or drive their lectures. At the time this book 
was published, slides typically cost $150 to $250 each. The National Gallery 
of Art produced a single compact disc that contains 1,645 paintings, sculptures, 
prints, and drawings from its collection. While zooming in and out is not 
possible, many of the portrayals come with a variety of detail-oriented frames. 

As a play-only disc, the product offers a five-minute history of the gallery 
followed by a tour of the 1,645 images. By dialing image numbers, viewers 
can organize the tour according to their desires. They can study, for example, 
how the portrayal of landscapes or the crucifixion or whatever changed over 
time or differed by country. When linked to an external computer, the images 
become a data base that not only can be organized according to the wants 
of the viewer, but through the use of programs known as "hypermedia," addi- 
tional visual, textual, or auditory information can be added, as well. 

While sound may not be so crucial to the viewing of paintings, it adds 
a major dimension to many programs in other areas. For example, for many 
species of birds, the rendering of their songs in print has always required 
imagination from the reader A March 5, 1993, segment on National Public 
Radio's "All Things Considered" described a disc that provides an audio 
of the song along with pictorial and textual information. 

Another example: The program "Dance of the Planets," a teaching pro- 
gram in astronomy, allows the user to leave the solar system and look back 
on it with all planets and the sun in view. The viewer of the skies can "walk 
around" the system obserx ing what it looks like from a variety of perspectives. 
From any perspective, the 9,000 stars visible in the heavens are always in 
their proper positions. To watch how the relationships among the planets 
change, viewers can speed up the motion. Or, they can pick a date m the 
past or future and find instantly how the planets configured themselves or 

will be configured. 

At the 1993 National Academy of Sciences conference, "Reinventing Schools: 
The Technology Is Now," attendees got glimpses of the sophisticated products 
not looming on the horizon but currently available. Among these was a disc 
that provides students with an enonnous range of information about music 
and instruments. Students can choose to explore jazz, classical, and a variety 
of other musical styles. If jazz is chosen, small groups, swing orchestras-the 

~ Rx Tia" 

1x8 



full range of styles— can be read about and listened la If the students choose 
classical music, they can choose symphonies and chamber ensembles, among 
other selections. Within the symphony, the students can hear selections repre- 
sentative of various eras, and they can choose to study about and iicar in- 
dividual instruments within an orchestra. Another disc allows students to 
sing songs along with a disc in English or French while watching the words 
presented in both languages. 

The conference, as well as various media published at the same time, 
w^s abuzz with talk about the "information highway" and the 500-channel 
"television" cable it portended. Although most examples seem to involve nothing 
more intellectual than ordering a movie on command and a pizza to eat 
along with it. the information highway will have, should have, major ramifica- 
tions for education. The Mecklenburger Group, a nationwide group of 
technolog)^-oriented educators, has begim to speak of de\'eloping, with deliberate 
allusion to Marshall McLuhan, "Global Village Schools," and to speak of 
school as a verb, not a noun. 



Impact on Teaching 

The classroom uses of the few examples given above go well beyond merely 
using a machine to present the same old curriculum. But will teachers use 
these programs? Three recent studies by different researchers— conducted 
at different times, using different methods— have produced stanlingly similar 
and highly encouraging results about how information technology affects 
the nature of teaching. 

Given computers and time (four to six years seems to be the needed 
interval, although one study found large changes in only two years), teachers 
will use the computers eflkiently and radically change the ways in which 
they teach. When computers are first introduced, teachers use them to strengthen 
whal they already are doing. Then the teachers begin to explore new uses 
and new ways of teaching. 

The studies also found teachers: 

• Teaching the whole class much less and working with small groups much 
more. 

• Taking risks with their students. 

• Viewing themselves more as coaches and facilitators than lecturers. 
These changes are in accord with current teacher training arguments, 

as well as with findings in cognitive psychology. 



Better relationships, more collaboration 

As described in Chapter 4 in quotes from Deborah Meier, interactions 
between students and teachers and among teachers often lack a sense of 
authenticity. Students cannot admit they are having trouble. Teachers, even 
less so. Questions, the essence of problem solving, are seen in too many 
schools as either (inadmissible) admissions of ignorance or challenges to 
authority. 

As one reads these reports, however, one strongly senses that introducing 
an alien object, the computer, into the classroom changes the power relation- 
ships among all actors. One report refers to the machine as "the great equal- 
izer."^ This is a nevN' instrument in the environment; it is a puzzle. That it 
is foreign to teachers as well as to many students appears to allow teachers 
to say, "We re all in this together." One senses teachers mobilizing all resources 
available, almost like an immune system, to deal with the invader. 

Riither than ejecting the foreign object from the system, however, teachers 
engage in a highly desirable collaboration with each other and the students 
to make the machine a known quantity. Indeed, this in itself, is no trivial 
outcome. Seymour Sarason, in Tfie Predictable Failure of School Reform, predicates 
any successful reform on Just such changes in power relationships between 
teachers and students, between teachers and administrators, and among teachei-s 
themselves.'* 

Further, the resulting changes in pedagog)' are in line with the ones that 
most instructional reformers are calling fon Said one report: 

Collaboration among teachers was an additional aspect of produc- 
tivity identified by many of the participating staff in each school. 
As specializxUion of computer skills emerged, teachers recognized that 
there was an instructional capability in-house. As a result, they could 
inquire and get support to learn new software and new skills, and 
receive help to accomplish Uisks with programs they did not know 
well. These collaborative activities also established new relationships 
among the faculties that resulted in more productive work settings. 
Several teachers reported collaboration on course development, on 
the development of common classroom procedures, and on reducing 
the time necessaiy to accomplish neces^ar)' administrative tasks* 

Innovative teacliing strategies 

Changes in teaching were even more extraordinary. Said one teacher in 



a representative comment, "As you work into using the computer in the classroom, 
you start questioning everything you have done in the past and wonder how 
you can adapt it to the computer. Then, you start questioning the whole 
concept of what you originally did.'' Wrote one set of researchers: 

[The computer] opened a path to a new instructional strategy 
that would engage students in a highly collaborative and creative activi- 
ty. As teachers reached this stage independently of each other, their 
roles began to shift noticeably, and a new instructional pattern emei^ed. 
Team teaching, interdisciplinary project-based instruction, and in- 
dividually patterned instruction became more and more common 
at all of the sites. To accommodate more ambitious class projects, 
teachers even altered that foundation of the traditional school day: 
the master schedule. . . . [Teachers were] more disposed to view learn- 
ing as an active, creative, and socially interactive process than they 
were when they entered the program. Knowledge is now held more 
as something children must construct and less like something that 
can be transferred intact? 



Impact on Achievement, Students 

None of these studies reports data on student outcomes, and perhaps, that 
is just as well at this time. Given what we have said about tests, it is clear 
that an assessment system that would do justice to the kinds of likely outcomes 
in these classrooms does not yet exist. 

Reports from students would have been nice, though. In one school district, 
one teacher of a mixed fifth-sixth grade persuaded the district and Tandy 
Corporation to provide laptop computers for his students. During the first 
year, budget constraints limited the use largely to word processing, but the 
results in writing were dramatic. 

The school was located in a middle class to poor area and test scores 
typically hovered around the 50th percentile. As part of a research project, 
the students' writing efforts were judged by teachers from othe * cchools which 
ser\'ed affluent families. Test scores at these schools were above the 80th per- 
centile. The teachers did not rate the papers in comparison to their own 
students, but when asked about their (juality pronounced them comparable 
to their students' average work. They were quite surprised when they learned 
where the papers came from.' 
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The students with computers also wrote more and much longer composi- 
tions than a comparable gi'oup without Cvomputers. They reported that having 
the computers, also used as calculators for math classes, made life easier and 
changed their attitudes about coming to school. 

Perhaps the most telling datum concerning the impact of computers airiv- 
ed inadvertently. As a result of a change in district policy, the fifth graders 
in the class, about 75 percent of the class, had an option to attend sixth 
grade in a middle school the next year or to remain in the elementary school 
for their sixth grade. An overwhelming majority of them chose the elementary 
school and often cited the computer as a factor in their decision. 

The possibilities of tiypermedia 

Looming as a product that caught even the computer-using adult world 
unprepared and then took it by storm is "hypennedia." Hypermedia is hard 
to explain using plain media, and it is somewhat misleading as a word. It 
was coined following "hypertext," a word invented earlier to describe non- 
linear text. Hypennedia tools allow the user to browse nonsequentially through 
text, pictures, and, in some instances, sound. Thus each person can peruse 
information following his or her own interests, not a predetermined sequence. 

Hypermedia has proven useful and interesting in adult settings, but its 
use in schools is as yet largely unexplored. Some view it as the next great 
thing. Others view it with terror: The idea of children browsing through 
a program at will or at random horrifies them. They argue that children 
need structure and that without it, their learning will be chaotic. 

The latter is a hypothesis, of course, and not a proven conclusion. As 
noted earlier, all people learn idiosyncratically to some extent. Whether or 
not hypermedia will increase the amount of creativity or leave people unable 
to communicate will likely depend on the design of the products. One resear- 
cher has reported that some early products leave people feeling lost in 
"hyperspace," which she describes as the feeling you get when you are lost 
in a British museum: You don't know where you are or what the hypermedia 
product's dimensions are. 

To date, hypermedia are rarely found in schools. One study in what might 
he considered a hybrid application of regular text and hypermedia obtained 
results suggesting hypermedia can help learning. In this study in an elementary 
school, reading matter appeared on a screen in typical page sequence, but 
children could choose or not choose a variety of hypermedia aids in whatever 



sequence they wished to help with the reading. The aids helped them to 
comprehend the text or to link pronouns to referents, or they pronounced 
difficult words for them. The children, in grades 1-3, were found to use the 
aids. Those who did and were in the program more than one year scored 
higher on reading tests than those who did not have the aids available to 
them. 

Impact on Thinking, Schools 

What computers will do to thinking is hard to predict. One parent, who 
also happened to be on the Harvard School of Education faculty, found that 
after her child had played a computer fantasy game in which the goal is 
to find a path to a treasure, he had constructed a geometry of what the 
fantasy world looked like. The parent felt it would be very- hard for adults 
to construct that which the child had found easy. It may be that computers 
will fundamentally alter the way people think. It may also be that tmly powerful 
software will arrive only after a generation raised on M1"V and videogames 
starts making it. 

A change in learner's relationship to knowledge 

It is hard to overestimate the potential of these powerful machines and 
the nascent technologies surrounding them. Author Lewis J. Perelman, in 
School's Out, declares that the new technologies will render information so 
universally available that schools will soon be obsolete.* Certainly the onset 
of "smart houses" equipped with computers, interactive videodiscs, software, 
with some built-in data bases and on-line access to others, can— will— make 
much more knowle, .ge readily available and will change the learners' relation- 
ship to knowledge. 

Change in information processing 

As we move into a more multimedia, less book-based culture and educa- 
tion system, we may witness, may have already witnessed, important changes 
in how children process information. The impact of television has been decried 
in many quarters, although its impact, at least as measured by test scores, 
is as yet indeterminate and complex. However, not only do children watch 
a great deal of television and videotape at home, they will experience multimedia 
in schools. 
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The impact of such experiences cannot fully be foreseen. Consider, for 
example, a group of gifted eighth-graders this author studied in a Rhode 
Island school. As one project, the students studied the search for the Tikinic 
Instead of simply reading about the events and taking notes, they: 

• Watched "A Night to Remember" and "20,000 Leagues Under the Sea." 

• Visited the nearby Woods Hole Oceanographic Institute and videotaped 
an interview with Robert Ballard, the man who led the search, 

• Organized themselves into teams to search for the Titanic using a com- 
puter simulation. And to complete the project, the students constructed 
a multimedia, hypermedia exhibition to show the other students in the 
school what they had been up to. Teachers of science, mathematics, literature, 
and physical education altered their courses to coordinate instruction 
with the project. 

A new "literacy** In one sense, these students may be less 'literate ' than 
they would have been had they spent the same amount of time simply reading 
about the project and writing individual reports. Their SAT verbal scores, 
dependent on written texts, may actually suffer. But it would be difficult to 
conclude that their experience was less intellectually rich or rigorous than 
one restricted to print media. It may turn out that the definition of *1iteracyr 
or at least the traditional value of traditional literac)\ may be obsolete. 

These students experiences, of course, are precisely what psychologists 
would say produce the most meaningful, long-lasting knowledge and skills. 
Unlike the unthinking science experiments described earlier, these students 
experienced the reasoned trial-and-error inherent in simulations and in science 
itself Not measured in any outcome is the impact of the teachers great en- 
thusiasm tor the project on the students impressions of what learning is all about. 

Many experts in the communications field agree that the changes in infor- 
mation processing produced by the new technologies will be profound, but 
not necessarily negative, Mitchell Stephens of New York University in "The 
Death of Reading" concludes that reading will not die and may e\'en prosper. 
We cannot know at this time how the new technologies will de\'el()p: 
And even those who believe that the decline in reading does herald 
some profound cultural changes are not convinced that those changes 
will necessarily be for the worse. Perhaps, they might argue, the logic 
inculcated by writing and print is not the only way of processing 
information about the world. Perhaps an immersion in electronic 
forms of communication might lead to different but equally valid ways 
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of being smart— forms of intelligence that go unrecognized by SAT 
tests. listening to that argiiment with more and more sympathy,' 
concedes [Donald] Stewart, [president] of The College Board. 

It is possible, moreover, that electronic forms of communication 
have more potential than is currently being expressed in either the 
vapid fantasies of Madonna videos or the static talk shows and costume 
dramas of public tele^'ision. These media might be capable, given 
time, of creating a culture as profound and deep as that of reading. , . 

It took 2,000 years of writing before an alphabet was developed. 
It took a centurv' and a half of printing before someone thought 
to print a novel or newspaper New communications technologies 
do not arrive upon the scene fully grown; they need time to develop 
the methods and forms that best exploit their potential.^ 
In any case, the possibilities briefly discussed in this chapter are a long 
way off. A study of international use of computers in education finds that, 
indeed, the United States was the first countrv' to buy many computers for 
use in schools.*" Paradoxically, this now leaves us behind other countries. 
Becauseof their delays, other nations have purcliased 16-bit and 32-bit machines 
while the 8-bit computer, exemplified by the various models of the Apple 
IL remains dominant in American schools. And, as one ^vag put it, 8-bit 
computers ai e barely woi th two bits any more. Yet only 3 percent of computers 
in schools are 386 or 486 machines, while another 10 percent are Macintoshes. 

The speed with which information technology becomes obsolete poses 
a new problem for schools. Advances in television just meant better pictures 
and sound. Progress is towards a known ideal. Advances in information 
technology', on the other hand, permit qualitatively different activities, allow- 
ing us to do things never before done. This means rapid obsolescence of 
machines. One school district, C^arrollton, Georgia, which has 1 ,600 computers 
for its 3,400 students and a network to link them, finds itself "tmpped'' by 
its own successes— unable to do what it wants to, what it thinks it needs 
to do to maximize its use of the technology^ The mostly 80286 machines 
lack the size and speed to cany out the district's goals. So does the network. 
It is estiniaicd that Carollton will need to spend 7 to 10 percent of its budget 
on information technology' to keep current. Compaied to expenditures in 
private industry, this is not an uni'easonable outlay, but it is one that schools 
have not faced or committed to before. 

The study of computer use around the world and in the United States 



reveals again what Becker had noted earlier: In many instances, computers 
have not become integral parts of instruction. Few students reported using 
them for more than one subject area. In addition, while American students 
report more computers available than do students in other countries, they 
also report more difficulties in gaining access to them. They also report fewer 
computers at home and, even when computers are available at home, American 
students are less likely to use them than are students in other countries. 
The evidence indicates, then, that for most school children, the information 
millennium will have to wait. 
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EPILOGUE 



We end this treatise here not because the entire system has been described. 
It has not. But a sufficient number of systemic components and their 
needs have been examined, with the aim of giving impetus to any number 
of reform efforts. We hope this furthers the dialogue on reform and helps 
the reader focus on some areas much in need of improvement, while pointing 
out that all is not lost in the cause of education. 

Perhaps another publication might examine reforms needed in airriculum, 
for various age levels; or in the role of school boards or in the preparation 
of teachers. (We have a long, sad histor)^ of staff development "days!*) This 
book, however, has shown the system as an interlocking mechanism that must 
be examined in its entirety to make real change happen. 
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